Page MenuHomePhabricator
Differential D21560

When documents are indexed, record the indexer version (versus the object version) and index epoch
ClosedPublic
Actions

Authored by epriestley on Feb 16 2021, 11:59 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sun, Apr 21, 4:18 PM
Unknown Object (File)
Sat, Apr 20, 5:33 PM
Unknown Object (File)
Thu, Apr 11, 7:29 AM
Unknown Object (File)
Thu, Mar 28, 10:06 AM
Unknown Object (File)
Mar 21 2024, 6:56 AM
Unknown Object (File)
Feb 8 2024, 4:46 PM
Unknown Object (File)
Jan 25 2024, 2:34 AM
Unknown Object (File)
Jan 17 2024, 12:35 AM
View All 53 Files
Subscribers
Restricted Owners Package

Details

Reviewers
None
Maniphest Tasks
T13587: Ferret may exhaust AUTO_INCREMENT ID space of "ngrams" table after many reindexes
Commits
rP6703fec3e27d: When documents are indexed, record the indexer version (versus the object…
Summary

Ref T13587. D21495 has significant changes to the ngram indexer, which might possibly contain bugs.

Make it easier to reindex a subset of documents (based on the date when the index was built, and/or the software version which generated the index).

This is in addition to the existing versioning, which is focused on object versions.

Test Plan

Ran bin/search index with various old and new arguments. Spot-checked the IndexVersion table.

Diff Detail

Repository
rP Phabricator
Branch
defrag2
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 25135
Build 34686: Run Core Tests
Build 34685: arc lint + arc unit

Event Timeline

epriestley created this revision.Feb 16 2021, 11:59 PM
Owners added a subscriber: Restricted Owners Package.Feb 16 2021, 11:59 PM
Harbormaster completed remote builds in B25134: Diff 51324.Feb 17 2021, 12:00 AM
epriestley requested review of this revision.Feb 17 2021, 12:00 AM
epriestley updated this revision to Diff 51325.Feb 17 2021, 12:03 AM
  • Fix typos and bugs, test more "--type" flag values.
Harbormaster completed remote builds in B25135: Diff 51325.Feb 17 2021, 12:04 AM
epriestley updated this revision to Diff 51326.Feb 17 2021, 12:06 AM
  • Correct "bin/index" -> "bin/search index".
Harbormaster completed remote builds in B25136: Diff 51326.Feb 17 2021, 12:07 AM
This revision was not accepted when it landed; it landed in state Needs Review.Feb 17 2021, 12:09 AM
Closed by commit rP6703fec3e27d: When documents are indexed, record the indexer version (versus the object… (authored by epriestley). · Explain Why
This revision was automatically updated to reflect the committed changes.
epriestley added a commit: rP6703fec3e27d: When documents are indexed, record the indexer version (versus the object….

Revision Contents
Changeset List

PathSize
resources/
sql/
autopatches/
2 lines
2 lines
src/
applications/
search/
index/
29 lines
management/
323 lines
storage/
8 lines

Diff 51325

View Options

resources/sql/autopatches/20210216.index.01.version.sql

Loading...
View Options

resources/sql/autopatches/20210216.index.02.epoch.sql

Loading...
View Options

src/applications/search/index/PhabricatorIndexEngine.php

Loading...
View Options

src/applications/search/management/PhabricatorSearchManagementIndexWorkflow.php

Loading...
View Options

src/applications/search/storage/PhabricatorSearchIndexVersion.php

Loading...
Phabricator · Built by Phacility