Page MenuHomePhabricator

Tokenizers - improve algorithm around exact matches.

Authored by btrahan on Jan 9 2015, 10:43 PM.
Referenced Files
Unknown Object (File)
Mon, Aug 15, 4:25 AM
Unknown Object (File)
Wed, Aug 10, 11:12 PM
Unknown Object (File)
Tue, Aug 9, 4:07 PM
Unknown Object (File)
Wed, Aug 3, 5:02 AM
Unknown Object (File)
Tue, Aug 2, 10:54 PM
Unknown Object (File)
Fri, Jul 29, 11:14 AM
Unknown Object (File)
Sat, Jul 23, 1:29 AM
Unknown Object (File)
Jul 14 2022, 1:40 AM



Fixes T6102. Gets the from D10867 running in the tokenizer. This thing is pretty copy / pastey, but I guess that's okay?

Test Plan

looked at a project tokenizer and typed "project". since I have a million things with the word "project" in it, I was delighted to see the "project" project first in this project tokenizer.

Diff Detail

rP Phabricator
Lint Not Applicable
Tests Not Applicable

Event Timeline

btrahan retitled this revision from to Tokenizers - improve algorithm around exact matches..
btrahan updated this object.
btrahan edited the test plan for this revision. (Show Details)
btrahan added a reviewer: epriestley.

whoops, will fix

forgot the "/g" on the quick regex I wrote in my text editor to update the iteration variables.

epriestley edited edge metadata.

yeah fix all that extra jj stuff

seems fine otherwise

This revision is now accepted and ready to land.Jan 9 2015, 10:52 PM

(Your update is fine, I was just looking at v1.)

This revision was automatically updated to reflect the committed changes.