Page MenuHomePhabricator

Execute project membership materialization as "SELECT" + "INSERT", not "INSERT ... SELECT"
ClosedPublic

Authored by epriestley on Jan 27 2021, 11:20 PM.
Tags
None
Referenced Files
Unknown Object (File)
Sat, Apr 20, 5:31 PM
Unknown Object (File)
Sun, Mar 31, 8:15 AM
Unknown Object (File)
Jan 19 2024, 9:35 PM
Unknown Object (File)
Jan 19 2024, 4:49 PM
Unknown Object (File)
Jan 15 2024, 5:17 PM
Unknown Object (File)
Jan 13 2024, 1:40 AM
Unknown Object (File)
Jan 9 2024, 7:59 AM
Unknown Object (File)
Jan 7 2024, 4:36 PM
Subscribers
None

Details

Summary

Ref T13596. See that task for discussion. Executing "INSERT ... SELECT" at default isolation levels requires more locking than executing "SELECT" + "INSERT" separately.

Decompose this "INSERT ... SELECT" into "SELECT + INSERT", and reformat it to execute a minimal set of changes instead of wiping everything out and then writing all of it back. In most cases, this means we write 1 row instead of O(number of project members) rows.

Test Plan
  • Created a project. Added and removed members, looked at database and saw a consistent membership/materialization list.
  • Created a subproject. Added and removed members, looked at database and saw a consistent membership/materialization list.

I wasn't successful in reproducing the LOCK WAIT issue locally by trying various concurrent SELECT / INSERT / INSERT ... SELECT strategies. It may depend on the "DELETE + INSERT ... SELECT" structure used here, or versions/config/etc, so we'll have to see how that fares in production.

Diff Detail

Repository
rP Phabricator
Branch
project1
Lint
Lint Passed
Unit
Tests Passed
Build Status
Buildable 25055
Build 34569: Run Core Tests
Build 34568: arc lint + arc unit