Page MenuHomePhabricator

Fulltext stopword filtering is applying before stemming and failing to filter forms of words which stem to stopwords
Closed, ResolvedPublic

Description

After D17672, we don't pass stopwords to the MyISAM/InnoDB fulltext engines to work around T12137.

However, this filtering applies before query tokens are stemmed, so query tokens which are not stopwords (like "having") but which stem to stopwords (in this case, "have") pass though the filter and then gum up the machinery.

Tokens should be filtered for having stopword nature after they are stemmed.

Revisions and Commits

Restricted Differential Revision
Restricted Differential Revision

Event Timeline

epriestley added a revision: Restricted Differential Revision.Apr 19 2017, 4:00 PM
epriestley closed this task as Resolved by committing Restricted Diffusion Commit.Apr 19 2017, 5:02 PM
epriestley added a commit: Restricted Diffusion Commit.
epriestley added a commit: Restricted Diffusion Commit.