HomePhabricator

(stable) Improve search stemmer performance for large inputs

Description

(stable) Improve search stemmer performance for large inputs

Summary:
Ref T12974. See PHI87. As in D18647, we can improve the performance of some UTF8 operations here.

Instead of calling phutil_utf8_strtolower() on each token separately, call it once on the entire input up front. This has the same effect.

Test Plan:

Reviewers: amckinley

Reviewed By: amckinley

Maniphest Tasks: T12974

Differential Revision: https://secure.phabricator.com/D18648

Details

Provenance
epriestleyAuthored on Sep 26 2017, 2:15 AM
epriestleyPushed on Sep 27 2017, 5:25 PM
Reviewer
amckinley
Differential Revision
D18648: Improve search stemmer performance for large inputs
Parents
rPHU9f4d688e576d: (stable) Promote 2017 Week 38
Branches
Unknown
Tags
Unknown
Tasks
T12974: Upgrading: "Ferret" Fulltext Engine
Build Status
Buildable 18564
Build 25008: Run Core Tests