Page MenuHomePhabricator

DrydockRelease
ActivePublic

Milestones

    • Milestone

Details

Description

Allocate software resources

Recent Activity

Dec 12 2018

joshuaspence added a comment to T12145: Resource allocator does not create new host resources when one is already active.

I'm having some trouble getting this new behaviour (which IIUC basically means that multiple hosts in a Drydock pool should be load-balanced across). In "active resources" I see three Drydock hosts, which all belong to the same Almanac service. In "active leases", however, I see only a single host lease and many working copy leases.

Dec 12 2018, 10:15 AM · Bug Report, Drydock

Dec 9 2018

joshuaspence added a comment to T12145: Resource allocator does not create new host resources when one is already active.

I'm having some trouble getting this new behaviour (which IIUC basically means that multiple hosts in a Drydock pool should be load-balanced across). In "active resources" I see three Drydock hosts, which all belong to the same Almanac service. In "active leases", however, I see only a single host lease and many working copy leases.

Dec 9 2018, 11:39 PM · Bug Report, Drydock

Nov 26 2018

epriestley added a project to T13223: "Land Revision" builds a commit message as an omnipotent user, not the revision author or landing user: Drydock.
Nov 26 2018, 5:53 PM · Drydock, Policy, Differential, Security

Nov 10 2018

epriestley updated the task description for T13073: Plans: Drydock for normal software use cases where builds take more than 45 seconds.
Nov 10 2018, 1:31 PM · Plans, Drydock

Nov 1 2018

epriestley closed T12145: Resource allocator does not create new host resources when one is already active as Resolved by committing rPb950f877c50c: Allow Drydock Blueprints to control "supplemental allocation" behavior so all….
Nov 1 2018, 1:06 AM · Bug Report, Drydock

Oct 30 2018

jwarner added a comment to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call.

Fantastic, thanks very much @epriestley! I had indeed intended to take care of this myself was on other work this and last week and planned to come back to this. It also would have taken me much longer to realize that drydock.lease.search wasn't yet upstream and how to proceed from there, so I'm glad to see you were able to handle this so easily!

Oct 30 2018, 9:39 PM · Drydock

Oct 27 2018

epriestley added a commit to T12145: Resource allocator does not create new host resources when one is already active: rP57b4b5981947: When a Drydock host based on an Almanac blueprint has its binding disabled….
Oct 27 2018, 2:20 PM · Bug Report, Drydock

Oct 26 2018

epriestley added a commit to T11694: Allow clients to generally reason about Drydock leases over the API: rP5f3a7cb41b17: Expose Drydock leases via Conduit.
Oct 26 2018, 1:12 PM · Restricted Project, Drydock
epriestley closed T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call as Resolved by committing rP5f3a7cb41b17: Expose Drydock leases via Conduit.
Oct 26 2018, 1:12 PM · Drydock
epriestley closed T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call, a subtask of T11694: Allow clients to generally reason about Drydock leases over the API, as Resolved.
Oct 26 2018, 1:12 PM · Restricted Project, Drydock

Oct 25 2018

epriestley added a comment to T12145: Resource allocator does not create new host resources when one is already active.

D19762 adds a "supplemental allocation" behavior, which basically lets blueprints say "I want to grow the pool instead of allowing this otherwise valid lease acquisition".

Oct 25 2018, 2:03 PM · Bug Report, Drydock
epriestley added a revision to T12145: Resource allocator does not create new host resources when one is already active: D19762: Allow Drydock Blueprints to control "supplemental allocation" behavior so all hosts in an Almanac pool get used.
Oct 25 2018, 1:59 PM · Bug Report, Drydock
epriestley added a comment to T12145: Resource allocator does not create new host resources when one is already active.

After that, both hosts will have resources and jobs will allocate randomly, which should be good enough.

Oct 25 2018, 12:57 PM · Bug Report, Drydock
epriestley added a revision to T12145: Resource allocator does not create new host resources when one is already active: D19761: When a Drydock host based on an Almanac blueprint has its binding disabled, stop handing out leases.
Oct 25 2018, 12:48 PM · Bug Report, Drydock
epriestley added a comment to T12145: Resource allocator does not create new host resources when one is already active.

I believe you can work around this today by disabling the binding to host "A" in Almanac, running one job (which will be forced to allocate on host "B"), then re-enabling the binding. After that, both hosts will have resources and jobs will allocate randomly, which should be good enough. This is exceptionally cumbersome and ridiculous, of course (and it's possible that it doesn't even work).

Oct 25 2018, 12:42 PM · Bug Report, Drydock
epriestley added a comment to T8153: Improve detection and recovery when resources are mangled outside of Drydock's control.

A specific subcase here is when the binding to an Almanac host has been disabled. We should possibly test this during Interface construction, treat it as a failure, then recover from it.

Oct 25 2018, 12:40 PM · Prioritized, Drydock
epriestley moved T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call from Backlog to Now on the Drydock board.
Oct 25 2018, 12:05 PM · Drydock
epriestley moved T12145: Resource allocator does not create new host resources when one is already active from Backlog to Now on the Drydock board.
Oct 25 2018, 12:03 PM · Bug Report, Drydock
epriestley added a comment to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call.

I believe D16594 should implement this, one way or another, unless I'm misunderstanding the request.

Oct 25 2018, 11:49 AM · Drydock
epriestley added a parent task for T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call: T11694: Allow clients to generally reason about Drydock leases over the API.
Oct 25 2018, 11:48 AM · Drydock
epriestley added a subtask for T11694: Allow clients to generally reason about Drydock leases over the API: T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call.
Oct 25 2018, 11:48 AM · Restricted Project, Drydock
epriestley added a revision to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call: D16594: Expose Drydock leases via Conduit.
Oct 25 2018, 11:40 AM · Drydock
epriestley added a comment to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call.

Complicating this: there is no drydock.lease.search call upstream. So you're probably running some variation of D16594? But that already has ownerPHIDs.

Oct 25 2018, 11:38 AM · Drydock

Oct 24 2018

epriestley added a comment to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call.

I'm happy to make these changes myself, or you mentioned wanting to contribute a patch?

Oct 24 2018, 12:17 AM · Drydock

Oct 23 2018

epriestley moved T13205: Perhaps, provide options for hardening long-lived and relatively stable directories in Drydock? from Backlog to Far Future on the Drydock board.
Oct 23 2018, 8:59 PM · Drydock

Oct 16 2018

epriestley added a project to T13212: Add 'ownerPHIDs' query constraint to 'drydock.lease.search' conduit call: Drydock.
Oct 16 2018, 2:32 PM · Drydock
epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Oct 16 2018, 1:36 PM · Plans, Harbormaster

Oct 12 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Oct 12 2018, 3:19 PM · Plans, Harbormaster

Oct 10 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Oct 10 2018, 11:42 PM · Plans, Harbormaster

Oct 1 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Oct 1 2018, 3:50 PM · Plans, Harbormaster

Sep 21 2018

epriestley triaged T13205: Perhaps, provide options for hardening long-lived and relatively stable directories in Drydock? as Wishlist priority.
Sep 21 2018, 11:27 PM · Drydock

Sep 19 2018

epriestley updated the task description for T13073: Plans: Drydock for normal software use cases where builds take more than 45 seconds.
Sep 19 2018, 12:53 PM · Plans, Drydock
epriestley updated the task description for T13073: Plans: Drydock for normal software use cases where builds take more than 45 seconds.
Sep 19 2018, 12:43 PM · Plans, Drydock
epriestley updated the task description for T13073: Plans: Drydock for normal software use cases where builds take more than 45 seconds.
Sep 19 2018, 12:37 PM · Plans, Drydock

Sep 14 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Sep 14 2018, 4:01 PM · Plans, Harbormaster

Sep 13 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Sep 13 2018, 2:44 PM · Plans, Harbormaster

Sep 7 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Sep 7 2018, 3:05 PM · Plans, Harbormaster

Aug 28 2018

epriestley added a commit to T13088: Plans: Harbormaster UI usability and interconnectedness: rP614f9ba1fba6: Allow unit test results to specify that their details are formatted with….
Aug 28 2018, 8:26 PM · Plans, Harbormaster
epriestley added a revision to T13088: Plans: Harbormaster UI usability and interconnectedness: D19615: Allow unit test results to specify that their details are formatted with remarkup when reporting to "harbormaster.sendmessage".
Aug 28 2018, 8:24 PM · Plans, Harbormaster
epriestley added a comment to T13088: Plans: Harbormaster UI usability and interconnectedness.

The unit test results also don't currently show on individual builds, which is a little whack?

Aug 28 2018, 8:05 PM · Plans, Harbormaster
epriestley added a comment to T13088: Plans: Harbormaster UI usability and interconnectedness.

See T13189#240682 for some planning on the Unit Test result table.

Aug 28 2018, 7:52 PM · Plans, Harbormaster

Aug 27 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Aug 27 2018, 10:21 PM · Plans, Harbormaster
epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Aug 27 2018, 10:16 PM · Plans, Harbormaster

Aug 3 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Aug 3 2018, 7:23 PM · Plans, Harbormaster
epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Aug 3 2018, 7:21 PM · Plans, Harbormaster

Jun 20 2018

hach-que added a comment to T11195: Drydock's working copy should run "git lfs fetch && git lfs checkout" for repositories known to use Git LFS.

Back when this was originally reported, I'm pretty sure git lfs clone didn't exist (or at least I wasn't aware of it's existence). The appropriate fix now is probably different to the fix suggested in the original report.

Jun 20 2018, 6:31 AM · Drydock, Feature Request
aeiser added a comment to T11195: Drydock's working copy should run "git lfs fetch && git lfs checkout" for repositories known to use Git LFS.

We have a similar issue - however I think the "fix" is probably worse then the workaround.

Jun 20 2018, 2:37 AM · Drydock, Feature Request

Jun 5 2018

joshuaspence added a member for Drydock: joshuaspence.
Jun 5 2018, 10:45 PM

Apr 16 2018

epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Apr 16 2018, 5:18 PM · Plans, Harbormaster
epriestley updated the task description for T13088: Plans: Harbormaster UI usability and interconnectedness.
Apr 16 2018, 5:18 PM · Plans, Harbormaster