Page MenuHomePhabricator

Dramatically increase cache hit rate for feed
ClosedPublic

Authored by epriestley on Jun 29 2015, 10:16 PM.
Tags
None
Referenced Files
Unknown Object (File)
Feb 14 2024, 12:43 AM
Unknown Object (File)
Feb 9 2024, 12:28 PM
Unknown Object (File)
Feb 9 2024, 9:55 AM
Unknown Object (File)
Feb 3 2024, 5:30 AM
Unknown Object (File)
Feb 2 2024, 5:12 PM
Unknown Object (File)
Jan 25 2024, 8:52 PM
Unknown Object (File)
Jan 19 2024, 12:17 AM
Unknown Object (File)
Jan 19 2024, 12:17 AM
Subscribers
Tokens
"Doubloon" token, awarded by btrahan.

Details

Summary

Ref T8631. The query plan for feed stories is really bad right now, because we miss caches we should be hitting:

  • The workspace cache is stored at each query, so adjacent queries can't benefit from the cache (only subqueries). Feed has primarily sibling queries.
    • There is no technical reason to do this. Store the workspace cache on the root query, so sibling queries can hit it.
  • In ObjectQuery, we check the workspace once, then load all the PHIDs. When the PHIDs are a mixture of transactions and objects, we always miss the workspace and load the objects twice.
    • Instead, check the workspace after loading each type of object.
  • HandleQuery does not set itself as the parent query for ObjectQuery, so handles never hit the workspace cache.
    • Pass it, so they can hit the workspace cache.
  • Feed's weird PhabricatorFeedStory::loadAllFromRows() method does not specify a parent query on its object/handle queries.
    • Just declare the object query to be the "root" query until this eventually gets cleaned up.
Test Plan

Saw queries for each object drop from 4-6x to 1x in /feed/.

Diff Detail

Repository
rP Phabricator
Branch
perf2
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 7062
Build 7177: [Placeholder Plan] Wait for 30 Seconds
Build 7176: arc lint + arc unit

Event Timeline

epriestley retitled this revision from to Dramatically increase cache hit rate for feed.
epriestley updated this object.
epriestley edited the test plan for this revision. (Show Details)
epriestley added a reviewer: btrahan.
  • Make sure omnipotent and public users can never share the same cache bucket.
  • Also use cache fragments in NamespaceQuery.
btrahan edited edge metadata.
This revision is now accepted and ready to land.Jun 30 2015, 6:10 PM
This revision was automatically updated to reflect the committed changes.