Page MenuHomePhabricator
Feed Advanced Search

Mar 22 2016

chad added projects to T10613: Include commit's branch information in activity feed: Feed, Diffusion.
Mar 22 2016, 11:05 PM · Diffusion, Feed, Feature Request

Mar 21 2016

chad updated subscribers of T10626: Spacing issue in Diffusion.
Mar 21 2016, 9:54 PM · Bug Report, Diffusion

Mar 20 2016

epriestley added a comment to T10619: Permit custom harbormaster actions from the diffusion/differential pages.

You can already do some of this: "Land Revision" itself is added to the menu via DifferentialLandingActionMenuEventListener. You can use listeners like this to extend the menu.

Mar 20 2016, 9:22 AM · Restricted Project, Diffusion, Differential, Harbormaster, Feature Request

Mar 19 2016

epriestley added a comment to T7789: Support Git Large File Storage.
  • Once D15499 lands, this is available as a prototype.
Mar 19 2016, 8:20 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 19 2016, 6:11 PM · Customer Impact, Restricted Project, Files, Diffusion
chad closed T10626: Spacing issue in Diffusion as Resolved by committing Restricted Diffusion Commit.
Mar 19 2016, 3:34 PM · Bug Report, Diffusion
chad added a revision to T10626: Spacing issue in Diffusion: Restricted Differential Revision.
Mar 19 2016, 3:16 PM · Bug Report, Diffusion
joshuaspence created T10626: Spacing issue in Diffusion.
Mar 19 2016, 12:16 AM · Bug Report, Diffusion

Mar 18 2016

chad closed T10615: Very large commit spacing seems off as Resolved.
Mar 18 2016, 7:07 PM · Diffusion, Bug Report
chad added a revision to T10615: Very large commit spacing seems off: Restricted Differential Revision.
Mar 18 2016, 7:07 PM · Diffusion, Bug Report
epriestley added a comment to T7789: Support Git Large File Storage.

The technically-functional-prototype code is live on this install, now:

Mar 18 2016, 4:46 PM · Customer Impact, Restricted Project, Files, Diffusion
eadler moved T10619: Permit custom harbormaster actions from the diffusion/differential pages from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 18 2016, 4:35 PM · Restricted Project, Diffusion, Differential, Harbormaster, Feature Request
eadler added a project to T10619: Permit custom harbormaster actions from the diffusion/differential pages: Restricted Project.
Mar 18 2016, 4:29 PM · Restricted Project, Diffusion, Differential, Harbormaster, Feature Request
eadler created T10619: Permit custom harbormaster actions from the diffusion/differential pages.
Mar 18 2016, 4:29 PM · Restricted Project, Diffusion, Differential, Harbormaster, Feature Request
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 18 2016, 3:44 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T10614: Images in Diffusion don't register as such in BrowseTable.

(There is also a different type of cache from <object hash -> metadata> we could build in Git, but that's kind of a lot of work.)

Mar 18 2016, 2:43 PM · Diffusion, Bug Report
epriestley added a comment to T10614: Images in Diffusion don't register as such in BrowseTable.

In SVN, we can use a different icon because we have prebuilt cache of file types (and must have this cache for other reasons, and can build this cache efficiently, and SVN distinguishes between binary and text files).

Mar 18 2016, 2:40 PM · Diffusion, Bug Report
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 18 2016, 2:25 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

Quick update:

Mar 18 2016, 1:42 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 18 2016, 1:27 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a revision to T10604: Allow application code to stream request data: Restricted Differential Revision.
Mar 18 2016, 1:27 PM · Diffusion (v3), Restricted Project
epriestley added a revision to T10604: Allow application code to stream request data: Restricted Differential Revision.
Mar 18 2016, 12:05 PM · Diffusion (v3), Restricted Project
cmmata added a comment to Q287: How to accept an audit with a project as reviewer?.

There is a similar discussion in T7676.

Mar 18 2016, 10:53 AM · Diffusion, Audit
cmmata added a comment to Q287: How to accept an audit with a project as reviewer?.

The same problem here. I have a lot of 'pending' audits because I did the commit and audited it. They have an accepted label in audit list, but 'partially audited' if I open the audit. It happens also if I'm the only member in the project that is needed to audit.

Mar 18 2016, 10:34 AM · Diffusion, Audit
epriestley added a comment to T7789: Support Git Large File Storage.

One issue which we'll hit eventually is that git-lfs doesn't currently support pushing to remotes by URL, but we push to staging areas by URL:

Mar 18 2016, 1:27 AM · Customer Impact, Restricted Project, Files, Diffusion

Mar 17 2016

epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 17 2016, 8:33 PM · Customer Impact, Restricted Project, Files, Diffusion
chad claimed T10615: Very large commit spacing seems off.
Mar 17 2016, 7:12 PM · Diffusion, Bug Report
chad created T10615: Very large commit spacing seems off.
Mar 17 2016, 7:12 PM · Diffusion, Bug Report
chad created T10614: Images in Diffusion don't register as such in BrowseTable.
Mar 17 2016, 7:10 PM · Diffusion, Bug Report
epriestley added a comment to T7789: Support Git Large File Storage.

No way for the upload API to say "no thanks, I already have that file"?

Mar 17 2016, 6:49 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

Quick progress update:

Mar 17 2016, 3:41 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T10264: git clone using http hangs after update.

D15483 changes the constant to 47 (15 window size + 32 for gzip + zlib), which should accept and decode the broadest possible range of inputs. If this somehow breaks something, 31 (15 window size + 16 for gzip only) is probably the next thing to try. See that change for discussion.

Mar 17 2016, 3:34 PM · Bug Report, Diffusion

Mar 16 2016

eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

We'll try that in our next upgrade. Thanks for the help!

Mar 16 2016, 10:05 PM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Here's a diff to make bin/storage adjust always run ANALYZE on every table after it makes other adjustments, but I'm not really sure if that's actually helpful or not (e.g., from the documentation, it sounds like the good analysis can be immediately overwritten by a bad one in some cases?):

Mar 16 2016, 10:01 PM · Infrastructure
epriestley added a revision to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates: Restricted Differential Revision.
Mar 16 2016, 9:50 PM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

I think so. Sorry for the originally misleading claim.Sorry for the originally misleading claim.

Mar 16 2016, 9:48 PM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Should we get rid of the <commitID, isDirect, changeType> key, then?

Mar 16 2016, 9:43 PM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Well, the docs suggest not doing that:

Mar 16 2016, 9:29 PM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Should we get rid of the <commitID, isDirect, changeType> key, then?

Mar 16 2016, 9:24 PM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

The discrepancy between staging + production is almost certainly caused by the size of the data.

You do not need to create a secondary index on changeId as that is the leftmost part of the primary key. The secondary index just points to the primary index where the data is stored.

The underlying cause of the slowness is because the stats were completely off in the production table (was showing cardnality of 18 for changeId).

Mar 16 2016, 9:13 PM · Infrastructure
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 16 2016, 7:49 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a revision to T10604: Allow application code to stream request data: Restricted Differential Revision.
Mar 16 2016, 6:06 PM · Diffusion (v3), Restricted Project
epriestley added a revision to T10264: git clone using http hangs after update: Restricted Differential Revision.
Mar 16 2016, 5:51 PM · Bug Report, Diffusion
epriestley added a revision to T10604: Allow application code to stream request data: Restricted Differential Revision.
Mar 16 2016, 5:51 PM · Diffusion (v3), Restricted Project
epriestley created T10604: Allow application code to stream request data.
Mar 16 2016, 5:46 PM · Diffusion (v3), Restricted Project
epriestley closed T10603: Make AuthTemporaryTokens suitable for use as LFS tokens, a subtask of T7789: Support Git Large File Storage, as Resolved.
Mar 16 2016, 4:35 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a revision to T7789: Support Git Large File Storage: Restricted Differential Revision.
Mar 16 2016, 2:51 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley closed T10530: Exception: Cursor "11972" does not identify a valid object in query "DiffusionCommitQuery". as Resolved.

bin/remove destroy gives you a huge scary red skull-and-crossbones ASCII art for good reason, and you're accepting that issues like this may occur when you confirm the prompt.

Mar 16 2016, 1:40 PM · Audit, Diffusion, Bug Report
• tinytiongson added a project to T10530: Exception: Cursor "11972" does not identify a valid object in query "DiffusionCommitQuery".: Audit.

The problem was encountered when we have deleted the existing repository with audits because we wanted to include not just the trunk but all its branches. The thing was that the deleted repository in Diffusion was not the first one to be imported again.

Mar 16 2016, 1:30 PM · Audit, Diffusion, Bug Report
epriestley changed the edit policy for T7789: Support Git Large File Storage.
Mar 16 2016, 12:18 PM · Customer Impact, Restricted Project, Files, Diffusion
MuratUrsavas updated Q338: How can I edit the documentation? from to How can I edit the documentation?.
Mar 16 2016, 8:36 AM · Diffusion

Mar 15 2016

epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Interesting (and weird). Thanks for the update -- and good luck figuring things out.

Mar 15 2016, 8:54 PM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Quick update here. We've found that adding FORCE INDEX (primary) results in 79.4ms in production even without the key_history index.

Mar 15 2016, 8:42 PM · Infrastructure
epriestley added a comment to T7789: Support Git Large File Storage.

Before I forget:

Mar 15 2016, 12:29 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a parent task for T4369: Phabricator HTTP repository hosting has fairly severe scalability limits: T7789: Support Git Large File Storage.
Mar 15 2016, 12:26 PM · Diffusion (v3), Restricted Project
epriestley added a subtask for T7789: Support Git Large File Storage: T4369: Phabricator HTTP repository hosting has fairly severe scalability limits.
Mar 15 2016, 12:26 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

Adjacent work:

Mar 15 2016, 12:26 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley updated subscribers of T4369: Phabricator HTTP repository hosting has fairly severe scalability limits.
Mar 15 2016, 12:26 PM · Diffusion (v3), Restricted Project
epriestley merged task T9739: Git push failure over HTTP for large commit (74MB) into T4369: Phabricator HTTP repository hosting has fairly severe scalability limits.
Mar 15 2016, 12:26 PM · Diffusion, Git
epriestley added a comment to T7789: Support Git Large File Storage.

Various notes from prototyping:

Mar 15 2016, 12:17 PM · Customer Impact, Restricted Project, Files, Diffusion

Mar 12 2016

epriestley updated the task description for T1130: Add Mercurial tag/bookmark support to Diffusion.
Mar 12 2016, 1:03 PM · Mercurial, Diffusion
epriestley merged T10573: Show Mercurial bookmarks in Diffusion into T1130: Add Mercurial tag/bookmark support to Diffusion.
Mar 12 2016, 1:02 PM · Mercurial, Diffusion
epriestley merged task T10573: Show Mercurial bookmarks in Diffusion into T1130: Add Mercurial tag/bookmark support to Diffusion.
Mar 12 2016, 1:02 PM · Mercurial, Diffusion, Feature Request
epriestley renamed T1130: Add Mercurial tag/bookmark support to Diffusion from Add Mercurial tag support to Diffusion to Add Mercurial tag/bookmark support to Diffusion.
Mar 12 2016, 1:02 PM · Mercurial, Diffusion
epriestley added a comment to T1130: Add Mercurial tag/bookmark support to Diffusion.

Ah, you're right, thanks! I misread that page -- that does make Mercurial tags a lot easier to deal with.

Mar 12 2016, 1:02 PM · Mercurial, Diffusion
isfs added a comment to T1130: Add Mercurial tag/bookmark support to Diffusion.

They're a function of an individual commit instead of being a function of the repository as a whole, so we'd have to do a lot more work to support them (it's not meaningful to, say, "list all tags in the repository", as it is with Git), ...

Mar 12 2016, 8:25 AM · Mercurial, Diffusion
isfs created T10573: Show Mercurial bookmarks in Diffusion.
Mar 12 2016, 8:10 AM · Mercurial, Diffusion, Feature Request
chad added projects to T10568: Report partially failed builds better in Diffusion history: Diffusion, Harbormaster.
Mar 12 2016, 12:48 AM · Restricted Project, Harbormaster, Diffusion, Feature Request

Mar 11 2016

eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Hrm, I'm going to do some followup with our DBAs as well. The performance numbers above were copied from the DBA analysis; however, when I make the change in production, rather than in staging, some of the behavior does not directly replicate.

Mar 11 2016, 1:51 AM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

I'll leave this open for now since the behavior still feels a bit spooky to me, let me know how things go once you get the key in place? If they're smooth, we can chalk this up to be being bad at MySQL.

Mar 11 2016, 1:41 AM · Infrastructure
epriestley added a revision to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates: Restricted Differential Revision.
Mar 11 2016, 1:36 AM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

I suppose the originally proposed key may be better than I think. I was imagining that it couldn't use the third part of the key (on changeType) but I suppose it actually can. I'm still confused by the UNION ALL behavior, but if the key's working on your dataset I think it's fine to add it -- it takes <1 second to add to our dataset, so even for large datasets it shouldn't be wildly unreasonable, even if we do find a better key later.

Mar 11 2016, 1:32 AM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

That's fine -- it looks like it's picking up the keys, I'm just not sure why it's then examining 303 million rows when it has the keys available.

Mar 11 2016, 1:24 AM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

to clarify: I removed the key I originally added

KEY `commitID` (`commitID`,`isDirect`,`changeType`)

was I not supposed to do that?

Mar 11 2016, 1:13 AM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Hrrm, let me see if I can reproduce anything like that, that's totally bizarre to me.

Mar 11 2016, 1:11 AM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.
KEY `cidid` (`commitID`,`isDirect`),
KEY `cidct` (`commitID`,`changeType`)

are the keys created

Mar 11 2016, 1:09 AM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.
id	select_type	table	type	possible_keys	key	key_len	ref	rows	Extra
1	PRIMARY	repository_pathchange	index	PRIMARY,cidid,cidct	cidid	5	NULL	303320447	Using where; Using index
2	UNION	repository_pathchange	index	PRIMARY,cidid,cidct	cidct	8	NULL	303320447	Using where; Using index
NULL	UNION RESULT	<union1,2>	ALL	NULL	NULL	NULL	NULL	NULL	Using temporary
Mar 11 2016, 1:08 AM · Infrastructure
epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

Hmm, weird. Can you show me the EXPLAIN SELECT ... for that?

Mar 11 2016, 1:08 AM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

That variant of the query is slow as well.

Mar 11 2016, 1:07 AM · Infrastructure

Mar 10 2016

epriestley added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

That key seems like it's probably not great for the OR changeType part of the query. If you still have the table handy and playing with it doesn't take an unreasonably huge amount of time, is this better?

Mar 10 2016, 11:09 PM · Infrastructure
eadler added a comment to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.

to clarify

KEY `commitID` (`commitID`,`isDirect`,`changeType`)
Mar 10 2016, 10:35 PM · Infrastructure
eadler moved T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 10 2016, 10:13 PM · Infrastructure
eadler added a project to T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates: Restricted Project.
Mar 10 2016, 10:13 PM · Infrastructure
eadler created T10560: Find ways to detect/fix/warn about MySQL indexes with poor cardinality estimates.
Mar 10 2016, 10:13 PM · Infrastructure
epriestley claimed T7789: Support Git Large File Storage.
Mar 10 2016, 6:24 PM · Customer Impact, Restricted Project, Files, Diffusion
eadler moved T4369: Phabricator HTTP repository hosting has fairly severe scalability limits from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 10 2016, 6:20 PM · Diffusion (v3), Restricted Project
eadler added a project to T4369: Phabricator HTTP repository hosting has fairly severe scalability limits: Restricted Project.
Mar 10 2016, 6:20 PM · Diffusion (v3), Restricted Project
epriestley added a comment to T7789: Support Git Large File Storage.

I'm going to figure out what the state of large PUTs

Mar 10 2016, 6:08 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

This may make sense to at least lightly entangle with T4752, which overlaps in some ways.

Mar 10 2016, 1:37 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

To do an integrity check, it looks like we have to compute the Git hash ourselves.

Mar 10 2016, 1:31 PM · Customer Impact, Restricted Project, Files, Diffusion
epriestley added a comment to T7789: Support Git Large File Storage.

As a general preface, this stuff makes me a little uneasy about LFS in its current state:

Mar 10 2016, 1:09 PM · Customer Impact, Restricted Project, Files, Diffusion

Mar 9 2016

eadler moved T8238: Formally support side-band change handoff in external repositories from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 9 2016, 10:11 PM · Restricted Project, Restricted Project, Diffusion, Harbormaster
• clark.woo.12 added a comment to T8747: "Path Does Not Exist" error caused by not standard characters.

i ran into the same problem

Mar 9 2016, 9:18 AM · Diffusion
• sergio.xga added a comment to T9190: Unhandled Exception ("FilesystemException") - File system entity `/var/repo/PHABES/' does not exist..

Hi guys,
Same issue here!

Mar 9 2016, 3:36 AM · Daemons, Diffusion

Mar 8 2016

eadler moved T6024: Display (post-push) audit-state in Diffusion commit-list from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 8 2016, 8:29 AM · Restricted Project, Audit, Diffusion
eadler moved T6024: Display (post-push) audit-state in Diffusion commit-list from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 8 2016, 8:29 AM · Restricted Project, Audit, Diffusion
eadler added a project to T6024: Display (post-push) audit-state in Diffusion commit-list: Restricted Project.
Mar 8 2016, 8:18 AM · Restricted Project, Audit, Diffusion
epriestley added a comment to T8238: Formally support side-band change handoff in external repositories.

If anyone else set up a cron job or similar to keep a staging area with a fresh master, you should be able to throw it away after users upgrade past T10509. That task has some details.

Mar 8 2016, 12:01 AM · Restricted Project, Restricted Project, Diffusion, Harbormaster
epriestley added a comment to T10509: When pushing changes to a staging area, also push the nearest ancestor present in the remote.

Aha! That makes sense, thanks for digging into it!

Mar 8 2016, 12:00 AM · Harbormaster (v3), Diffusion, Arcanist

Mar 7 2016

avivey added a comment to T10509: When pushing changes to a staging area, also push the nearest ancestor present in the remote.

tl;dr: looks good!

Mar 7 2016, 11:57 PM · Harbormaster (v3), Diffusion, Arcanist