Page MenuHomePhabricator

Build a prototype fulltext engine ("Ferret") using only basic MySQL primitives
ClosedPublic

Authored by epriestley on Aug 28 2017, 9:35 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sat, May 4, 10:02 PM
Unknown Object (File)
Fri, May 3, 8:44 PM
Unknown Object (File)
Wed, May 1, 1:25 PM
Unknown Object (File)
Mon, Apr 29, 12:54 PM
Unknown Object (File)
Sun, Apr 28, 6:13 PM
Unknown Object (File)
Thu, Apr 25, 2:10 AM
Unknown Object (File)
Fri, Apr 19, 6:46 PM
Unknown Object (File)
Wed, Apr 17, 6:21 AM
Subscribers
None

Details

Summary

Ref T12819. I gave this stuff a sweet code name because all the terms related to "fulltext" and "search" already mean 5 different things. It, uh, ferrets out documents for you?

I'm building this to work a lot like the existing ngram index, which seems to work pretty well. If this sticks, it will auto-resolve the join issue (in T12443) by letting us do the entire thing locally in a JOIN and thus dodge a lot of mess.

This index gets built alongside other indexes, but only shows up in the UI if you have prototypes enabled. If you do, it appears under the existing fulltext field in Maniphest. No existing functionality is affected or disrupted.

NOTE: The query engine half of this is still EXTREMELY primitive, and this probably performs worse than the existing field for now. If this doesn't show obvious signs of being awful on secure I'll improve that in followup changes.
Test Plan

Indexed my tasks, ran some simple queries, got the results I wanted, even for queries "ko", "k", "v0.1".

Screen Shot 2017-08-28 at 2.26.28 PM.png (740×434 px, 54 KB)

Diff Detail

Repository
rP Phabricator
Branch
ferret1
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 18190
Build 24458: Run Core Tests
Build 24457: arc lint + arc unit