Page MenuHomePhabricator
Feed All Stories

Sep 1 2019

epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 5:29 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 5:19 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 5:12 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 5:09 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 4:51 PM · Phacility, Infrastructure
epriestley added a comment to T13399: Remove "instances.queryinstances" Conduit API method.

SyncWorkflow also depends on creatorPHID to synchronize the initial administrator account.

Sep 1 2019, 4:48 PM · Phacility
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 4:44 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 4:41 PM · Phacility, Infrastructure
leoluk added a comment to D18651: Make "arc diff" sort of detect dependent revisions.

If users are actually building changes that depend on one anothers' unlanded changes, we could revisit this rule once we're more confident the simpler cases work.

Sep 1 2019, 8:30 AM
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 12:35 AM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 12:20 AM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Sep 1 2019, 12:19 AM · Phacility, Infrastructure

Aug 31 2019

epriestley added a comment to T13401: Phacility 2019 Week 35 Deployment Log.

The primary Week 34 / Week 35 deployment has completed without apparent issues. I'm going to deploy some followup changes for T13393 later, but it looks like we're out of the woods on the bulk of outbound changes.

Aug 31 2019, 5:15 PM · Phacility
epriestley updated the task description for T13401: Phacility 2019 Week 35 Deployment Log.
Aug 31 2019, 4:42 PM · Phacility
epriestley added a comment to T13401: Phacility 2019 Week 35 Deployment Log.

Clicking "Pay Now" from landing page fatals in "PhortuneCartCheckoutController.php:104"; "Call to undefined method PhortuneCartCheckoutController::buildCartContentTable()"
Pacts have a bad URI for billing accounts on the "Billing" tab.
Instances also have a bad URI for billing accounts on the "Billing " tab. Maybe the handle is using the wrong URI?
The sync worker is failing on new instance launch for lack of credentials.

Aug 31 2019, 4:38 PM · Phacility
epriestley committed rP24dbff241be1: (stable) Clean up two straggling UI issues in Phortune (authored by epriestley).
(stable) Clean up two straggling UI issues in Phortune
Aug 31 2019, 4:37 PM
epriestley committed rPb2b17485b957: Clean up two straggling UI issues in Phortune (authored by epriestley).
Clean up two straggling UI issues in Phortune
Aug 31 2019, 4:37 PM
epriestley added a comment to T13401: Phacility 2019 Week 35 Deployment Log.

The sync worker is failing on new instance launch for lack of credentials.

Aug 31 2019, 4:30 PM · Phacility
epriestley updated the task description for T13401: Phacility 2019 Week 35 Deployment Log.
Aug 31 2019, 4:26 PM · Phacility
epriestley triaged T13401: Phacility 2019 Week 35 Deployment Log as Normal priority.
Aug 31 2019, 4:10 PM · Phacility
epriestley triaged T13400: Evaluate performance impact of performing MySQL dump/restore in parallel as Wishlist priority.
Aug 31 2019, 4:04 PM · Infrastructure, Database
epriestley edited the content of Changelog.
Aug 31 2019, 2:57 PM
epriestley created an object: 2019 Week 35 (Very Late August).
Aug 31 2019, 2:56 PM
epriestley committed rPHU794ded985711: (stable) Promote 2019 Week 35 (authored by epriestley).
(stable) Promote 2019 Week 35
Aug 31 2019, 2:54 PM
epriestley committed rP4fca51c75cd6: (stable) Promote 2019 Week 35 (authored by epriestley).
(stable) Promote 2019 Week 35
Aug 31 2019, 2:54 PM
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

bin/host restart does not start no-daemon services.

Aug 31 2019, 2:35 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Aug 31 2019, 1:46 AM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Aug 31 2019, 1:40 AM · Phacility, Infrastructure
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

daemon behaviors

Aug 31 2019, 12:00 AM · Phacility, Infrastructure

Aug 30 2019

epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Aug 30 2019, 8:21 PM · Phacility, Infrastructure
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

Provisioning was once close-ish to automated. Is this close enough to automate?

Aug 30 2019, 5:34 PM · Phacility, Infrastructure
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

I think this leaves us with:

Aug 30 2019, 5:19 PM · Phacility, Infrastructure
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

Adjacent is the older instances.queryinstances API method. This is still used by service synchronization.

Aug 30 2019, 5:09 PM · Phacility, Infrastructure
epriestley triaged T13399: Remove "instances.queryinstances" Conduit API method as Wishlist priority.
Aug 30 2019, 5:08 PM · Phacility
epriestley committed rP533a5535b6f0: Remove the "grant authority" mechanism from users (authored by epriestley).
Remove the "grant authority" mechanism from users
Aug 30 2019, 4:26 PM
epriestley closed D20754: Remove the "grant authority" mechanism from users.
Aug 30 2019, 4:26 PM
epriestley requested review of D20754: Remove the "grant authority" mechanism from users.
Aug 30 2019, 4:17 PM
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: D20754: Remove the "grant authority" mechanism from users.
Aug 30 2019, 4:15 PM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Aug 30 2019, 4:12 PM · Phacility, Infrastructure
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

It is also used to cache InstancesManageCapability::CAPABILITY but this can easily just be cached in the request cache instead.

Aug 30 2019, 3:50 PM · Phacility, Infrastructure
epriestley added a comment to T13396: Support downloads of 2GB+ files with HTTPSFuture.

The operation in PHI1329 (against a ~8GB export) went through cleanly. Remaining work here is:

Aug 30 2019, 3:42 PM · Infrastructure, libphutil
epriestley added a revision to T13396: Support downloads of 2GB+ files with HTTPSFuture: Unknown Object (Differential Revision).
Aug 30 2019, 2:12 AM · Infrastructure, libphutil
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

The "Instance" almanac service type can be destroyed.

Aug 30 2019, 1:51 AM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Unknown Object (Differential Revision).
Aug 30 2019, 1:50 AM · Phacility, Infrastructure
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: Restricted Differential Revision.
Aug 30 2019, 12:29 AM · Phacility, Infrastructure

Aug 29 2019

epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

Can we get rid of the instance-specific services completely now, after changes connected to T11413?

Aug 29 2019, 10:50 PM · Phacility, Infrastructure
epriestley committed rP3c26e384872a: Provide a simple read-only maintenance mode for repositories (authored by epriestley).
Provide a simple read-only maintenance mode for repositories
Aug 29 2019, 10:23 PM
epriestley closed D20748: Provide a simple read-only maintenance mode for repositories.
Aug 29 2019, 10:23 PM
epriestley triaged T13398: Merge "ExecFuture" and "PhutilExecPassthru" and support selective passthru of individual pipes as Low priority.
Aug 29 2019, 10:07 PM · Infrastructure, libphutil
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

Mostly-promising answers on much of the rest of this:

Aug 29 2019, 10:05 PM · Phacility, Infrastructure
epriestley added a revision to T13397: "bin/host upload" and the Uploader wrapper should retry chunks on HTTP/504, and perhaps other status codes: Unknown Object (Differential Revision).
Aug 29 2019, 9:14 PM · Infrastructure, Arcanist
epriestley added a comment to T13397: "bin/host upload" and the Uploader wrapper should retry chunks on HTTP/504, and perhaps other status codes.

For posterity, bleugh:

Aug 29 2019, 8:41 PM · Infrastructure, Arcanist
epriestley added a comment to T13397: "bin/host upload" and the Uploader wrapper should retry chunks on HTTP/504, and perhaps other status codes.

I have a patch for this, but I'm not thrilled about the retry model. Maybe better would be for the caller retry the actual upload operation (which will automatically resume) and bail out while retaining the temporary file. Even if we retry on 504, we lose a lot of progress if there's a service interruption for longer than we're willing to sit in a retry loop.

Aug 29 2019, 8:33 PM · Infrastructure, Arcanist
epriestley requested review of D20748: Provide a simple read-only maintenance mode for repositories.
Aug 29 2019, 8:07 PM
epriestley added a revision to T13393: Improve repository shard migration pathway in the shared cluster: D20748: Provide a simple read-only maintenance mode for repositories.
Aug 29 2019, 8:05 PM · Phacility, Infrastructure
epriestley triaged T13397: "bin/host upload" and the Uploader wrapper should retry chunks on HTTP/504, and perhaps other status codes as Low priority.
Aug 29 2019, 8:02 PM · Infrastructure, Arcanist
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

I'm hoping this is a reasonable excuse to find a way forward [on >2GB downloads] here.

Aug 29 2019, 7:16 PM · Phacility, Infrastructure
epriestley committed rPHU379fd58429ff: (stable) Add a rough "ProgressSink" for improved progress reporting flexibility (authored by epriestley).
(stable) Add a rough "ProgressSink" for improved progress reporting flexibility
Aug 29 2019, 7:08 PM
epriestley committed rPHUdb94ec322abf: (stable) Allow HTTPSFuture to stream very large files directly to disk (authored by epriestley).
(stable) Allow HTTPSFuture to stream very large files directly to disk
Aug 29 2019, 7:08 PM
epriestley committed rPHU71e8d7a4cf8e: Add a rough "ProgressSink" for improved progress reporting flexibility (authored by epriestley).
Add a rough "ProgressSink" for improved progress reporting flexibility
Aug 29 2019, 7:07 PM
epriestley closed D20746: Add a rough "ProgressSink" for improved progress reporting flexibility.
Aug 29 2019, 7:07 PM
epriestley committed rPHU45c553b5c1d5: Allow HTTPSFuture to stream very large files directly to disk (authored by epriestley).
Allow HTTPSFuture to stream very large files directly to disk
Aug 29 2019, 7:06 PM
epriestley closed D20745: Allow HTTPSFuture to stream very large files directly to disk.
Aug 29 2019, 7:06 PM
epriestley added a revision to T13396: Support downloads of 2GB+ files with HTTPSFuture: Unknown Object (Differential Revision).
Aug 29 2019, 7:03 PM · Infrastructure, libphutil
epriestley requested review of D20746: Add a rough "ProgressSink" for improved progress reporting flexibility.
Aug 29 2019, 7:01 PM
epriestley added a revision to T13396: Support downloads of 2GB+ files with HTTPSFuture: D20746: Add a rough "ProgressSink" for improved progress reporting flexibility.
Aug 29 2019, 7:00 PM · Infrastructure, libphutil
pasik added a comment to T9821: Allow Harbormaster build plans to run on branch push instead of per-commit.

Also an example how "per-push notification" is implemented in Github events/webhooks:

Aug 29 2019, 6:18 PM · Restricted Project, Harbormaster
pasik added a comment to T9821: Allow Harbormaster build plans to run on branch push instead of per-commit.

I actually found my way here from discourse where the need for this was discussed:

Aug 29 2019, 6:04 PM · Restricted Project, Harbormaster
epriestley requested review of D20745: Allow HTTPSFuture to stream very large files directly to disk.
Aug 29 2019, 5:38 PM
epriestley added a revision to T13396: Support downloads of 2GB+ files with HTTPSFuture: D20745: Allow HTTPSFuture to stream very large files directly to disk.
Aug 29 2019, 5:38 PM · Infrastructure, libphutil
epriestley added a comment to T13396: Support downloads of 2GB+ files with HTTPSFuture.

This is something of an aside, but it would be nice to formalize PhutilConsoleProgressBar into a generic progress sink. A lot of bin/storage dump-related stuff could use this and bin/host download could obviously use it, and we likely have some use cases for reporting progress to the web via the API, but PhutilConsoleProgressBar lacks an indirection layer to really make this work cleanly.

Aug 29 2019, 5:19 PM · Infrastructure, libphutil
epriestley added a comment to T13396: Support downloads of 2GB+ files with HTTPSFuture.

My tentative plan is to add methods for sending the output to disk to HTTPSFuture, then go down the new parser pathway only if we're writing to disk. This should limit the amount of surface area exposed on the new parser.

Aug 29 2019, 4:33 PM · Infrastructure, libphutil
epriestley closed T12907: Unable to download large files through alternative file domain as Resolved.

This task covers a lot of ground and many of the issues have been resolved. There are two remaining issues which are more narrowly covered by these followups:

Aug 29 2019, 3:54 PM · Bug Report
epriestley added a comment to T13393: Improve repository shard migration pathway in the shared cluster.

Is the 2GB HTTP stuff in T12907 realistic to fix?

Aug 29 2019, 3:52 PM · Phacility, Infrastructure
epriestley claimed T13396: Support downloads of 2GB+ files with HTTPSFuture.
Aug 29 2019, 3:51 PM · Infrastructure, libphutil
epriestley created T13396: Support downloads of 2GB+ files with HTTPSFuture.
Aug 29 2019, 3:51 PM · Infrastructure, libphutil
epriestley triaged T13395: Strip libphutil for parts as Low priority.
Aug 29 2019, 3:41 PM · libphutil
epriestley updated the task description for T13394: Evaluate Okta OAuth.
Aug 29 2019, 3:27 PM · Auth
epriestley updated the task description for T13394: Evaluate Okta OAuth.
Aug 29 2019, 3:27 PM · Auth
epriestley triaged T13394: Evaluate Okta OAuth as Low priority.
Aug 29 2019, 3:26 PM · Auth
epriestley added a comment to T10127: Migrating repository between storage hosts in a cluster.

Not necessarily applicable in the general case, but see also T13393.

Aug 29 2019, 3:09 PM · Clusters, Feature Request
epriestley triaged T13393: Improve repository shard migration pathway in the shared cluster as Normal priority.
Aug 29 2019, 3:04 PM · Phacility, Infrastructure
epriestley triaged T13392: Current implementations of "X-Forwarded-For" may take the wrong element as Normal priority.
Aug 29 2019, 2:42 PM · Infrastructure
epriestley updated the task description for T13367: Phortune "enterprise" update errata.
Aug 29 2019, 3:19 AM · Phortune, Phacility

Aug 28 2019

epriestley committed rPHU5060bdf9726b: Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes (authored by epriestley).
Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes
Aug 28 2019, 6:56 PM
epriestley closed D20744: Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes.
Aug 28 2019, 6:56 PM
epriestley closed T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock as Resolved by committing rPHU5060bdf9726b: Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes.
Aug 28 2019, 6:56 PM · Infrastructure, libphutil
epriestley requested review of D20744: Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes.
Aug 28 2019, 6:55 PM
epriestley added a revision to T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock: D20744: Force HTTP/1.1 in HTTPSFuture until HTTP/2 support stabilizes.
Aug 28 2019, 6:55 PM · Infrastructure, libphutil
epriestley added a comment to T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock.

A possible issue is that letting cURL pick a protocol might lead to it selecting HTTP/1.0 in some cases (how/when could it possibly do this?

Aug 28 2019, 6:51 PM · Infrastructure, libphutil
epriestley added a comment to T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock.

According to curl/symbols-in-versions (this is a text file in the repository):

Aug 28 2019, 6:46 PM · Infrastructure, libphutil
epriestley added a comment to T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock.

A possible issue is that letting cURL pick a protocol might lead to it selecting HTTP/1.0 in some cases (how/when could it possibly do this? Only by hard-coding known-broken hostnames, I think?), and forcing it to use HTTP/1.1 could break those cases, so maybe I'll go spelunking here. I also can't immediately find a date of introduction for CURL_HTTP_VERSION_1_1 from the documentation.

Aug 28 2019, 6:44 PM · Infrastructure, libphutil
epriestley triaged T13391: Recent versions of cURL default to HTTP/2, but HTTP/2 is newfangled poppycock as Normal priority.
Aug 28 2019, 6:39 PM · Infrastructure, libphutil
epriestley added a comment to T13376: Write about "add more logging / monitoring / tests".

Another variation of this is "add more documentation", although I think the pattern around this one is more rarely a sort of "problem domain / solution domain mismatch" sort of issue and more often a "human communication" issue, usually with one of these two templates:

Aug 28 2019, 3:39 PM · Guides
epriestley committed rPc6642213d57f: Straighten out replication/cache behavior in "bin/storage dump" (authored by epriestley).
Straighten out replication/cache behavior in "bin/storage dump"
Aug 28 2019, 3:25 PM
epriestley closed D20743: Straighten out replication/cache behavior in "bin/storage dump".
Aug 28 2019, 3:25 PM
epriestley closed T13336: "bin/storage dump" option "--for-replica" might not interact properly with "--no-indexes" and PERSISTENCE_CACHE as Resolved by committing rPc6642213d57f: Straighten out replication/cache behavior in "bin/storage dump".
Aug 28 2019, 3:25 PM · Infrastructure
epriestley requested review of D20743: Straighten out replication/cache behavior in "bin/storage dump".
Aug 28 2019, 3:21 PM
epriestley added a revision to T13336: "bin/storage dump" option "--for-replica" might not interact properly with "--no-indexes" and PERSISTENCE_CACHE: D20743: Straighten out replication/cache behavior in "bin/storage dump".
Aug 28 2019, 3:19 PM · Infrastructure
epriestley added a comment to T13336: "bin/storage dump" option "--for-replica" might not interact properly with "--no-indexes" and PERSISTENCE_CACHE.

An adjacent issue is that PhabricatorMarkupCache is not currently marked as having cache persistence

Aug 28 2019, 2:06 PM · Infrastructure