Differential D20839

In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale better
ClosedPublic
Actions

Authored by epriestley on Sep 25 2019, 10:12 PM.

Details

Reviewers: None
Maniphest Tasks: T13414: Raise the effective corpus size limit in "PhutilProseDifferenceEngine" by using "diff" for coarse passes
Commits: rP884cd74cc4a5: In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale better

Summary

Depends on D20838. Fixes T13414. Instead of doing coarse diffing with "PhutilEditDistanceMatrix", use hash-and-diff with "DocumentEngine".

Test Plan

On a large document (~3K top level blocks), saw a more sensible diff, instead of the whole thing falling back to "everything changed" mode.
On a small document, still saw a sensible granular diff.

Screen Shot 2019-09-25 at 2.55.12 PM.png (699×849 px, 190 KB)

Diff Detail

Repository

rP Phabricator

Branch

jupyter10

Lint

Lint Passed

Unit

Tests Passed

Build Status

Buildable 23497
Build 32295: Run Core Tests
Build 32294: arc lint + arc unit

Event Timeline

epriestley created this revision.Sep 25 2019, 10:12 PM

Harbormaster completed remote builds in B23497: Diff 49670.Sep 25 2019, 10:14 PM

epriestley requested review of this revision.Sep 25 2019, 10:14 PM

This revision was not accepted when it landed; it landed in state Needs Review.Sep 25 2019, 11:50 PM

Closed by commit rP884cd74cc4a5: In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale better (authored by epriestley). · Explain Why

This revision was automatically updated to reflect the committed changes.

epriestley added a commit: rP884cd74cc4a5: In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale better.

Revision Contents
Changeset List

Path

Size

src/

__phutil_library_map__.php

applications/

files/

diff/

PhabricatorDocumentEngineBlocks.php

23 lines

infrastructure/

diff/

prose/

PhutilProseDifferenceEngine.php

150 lines

__tests__/

PhutilProseDiffTestCase.php

3 lines

Diff 49670

View Options

src/__phutil_library_map__.php

View Options

src/applications/files/diff/PhabricatorDocumentEngineBlocks.php

View Options

src/infrastructure/diff/prose/PhutilProseDifferenceEngine.php

View Options

src/infrastructure/diff/prose/tests/PhutilProseDiffTestCase.php

In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale betterClosedPublicActions

Details

Diff Detail

Event Timeline

Revision ContentsChangeset List

Diff 49670

src/__phutil_library_map__.php

src/applications/files/diff/PhabricatorDocumentEngineBlocks.php

src/infrastructure/diff/prose/PhutilProseDifferenceEngine.php

src/infrastructure/diff/prose/__tests__/PhutilProseDiffTestCase.php

In prose diffs, use hash-and-diff for coarse "level 0" diffing to scale better
ClosedPublic
Actions

Revision Contents
Changeset List

src/infrastructure/diff/prose/tests/PhutilProseDiffTestCase.php