Page MenuHomePhabricator

Add a garbage collector for common ngrams
ClosedPublic

Authored by epriestley on Oct 5 2017, 12:27 AM.
Tags
None
Referenced Files
F18509139: D18687.id.diff
Fri, Sep 5, 3:14 AM
F18501712: D18687.diff
Thu, Sep 4, 9:55 PM
F18324185: D18687.id.diff
Sun, Aug 24, 7:12 PM
F18303952: D18687.diff
Sat, Aug 23, 10:16 PM
F18091672: D18687.diff
Aug 7 2025, 12:06 AM
F17746892: D18687.diff
Jul 21 2025, 9:03 PM
F17711920: D18687.diff
Jul 17 2025, 9:19 AM
Unknown Object (File)
Apr 20 2025, 10:22 PM
Subscribers
None

Details

Summary

Ref T13000. After an ngram is marked as "common", we can delete it from the storage table.

Currently, the only way to get ngrams marked as "common" is to manually run bin/search ngrams, so this has no impact on normal installs.

Test Plan

Ran bin/garbage collect, saw it start chewing through my local Maniphest ngrams table and removing common ngrams.

Diff Detail

Repository
rP Phabricator
Branch
garbage1
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 18641
Build 25113: Run Core Tests
Build 25112: arc lint + arc unit

Event Timeline

  • Also add a little warning text to bin/search ngrams.
This revision is now accepted and ready to land.Oct 5 2017, 6:01 PM
This revision was automatically updated to reflect the committed changes.