Page MenuHomePhabricator
Feed All Stories

Jun 26 2019

epriestley closed D20620: When matching process titles, don't attempt a match if we're out of "argv" parts.
Jun 26 2019, 1:26 AM
amckinley added a comment to T13321: "bin/phd" may try to kill processes it does not own if the daemon PID logfiles on disk are out of date.

cd provides "at least once" delivery guarantees.

Jun 26 2019, 12:13 AM · Daemons, Phacility

Jun 25 2019

D20620: When matching process titles, don't attempt a match if we're out of "argv" parts is now accepted and ready to land.
Jun 25 2019, 10:44 PM
epriestley requested review of D20620: When matching process titles, don't attempt a match if we're out of "argv" parts.
Jun 25 2019, 10:21 PM
epriestley added a revision to T13321: "bin/phd" may try to kill processes it does not own if the daemon PID logfiles on disk are out of date: D20620: When matching process titles, don't attempt a match if we're out of "argv" parts.
Jun 25 2019, 10:21 PM · Daemons, Phacility
epriestley committed rPHU71666e588072: Make "PhutilProcessQuery" detection of overseer processes more robust (authored by epriestley).
Make "PhutilProcessQuery" detection of overseer processes more robust
Jun 25 2019, 9:57 PM
epriestley closed D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.
Jun 25 2019, 9:57 PM
epriestley committed rP2d2626d73f0b: (stable) Bump the remarkup cache version after JIRA/Asana rule changes (authored by epriestley).
(stable) Bump the remarkup cache version after JIRA/Asana rule changes
Jun 25 2019, 9:57 PM
epriestley committed rP987e10461056: Bump the remarkup cache version after JIRA/Asana rule changes (authored by epriestley).
Bump the remarkup cache version after JIRA/Asana rule changes
Jun 25 2019, 9:56 PM
epriestley closed D20619: Bump the remarkup cache version after JIRA/Asana rule changes.
Jun 25 2019, 9:56 PM
epriestley added a comment to D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.

Yeah, I suppose most of my skepticism comes from not knowing any other examples of long-loved processes parsing ps output instead of using PID files.

Jun 25 2019, 9:50 PM
D20619: Bump the remarkup cache version after JIRA/Asana rule changes is now accepted and ready to land.
Jun 25 2019, 8:32 PM
amckinley added a comment to D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.

Oh, and this might be useful, but is probably less portable than just using ps.

Jun 25 2019, 8:31 PM
D20616: Make "PhutilProcessQuery" detection of overseer processes more robust is now accepted and ready to land.
  • The disk can be full, or read-only. Or become full later, including while the daemon is running.
    • Any of these policy/disk state problems can pass any effort we make to test them early, then fail after the process daemonizes, making it difficult to report the failure to the user.
Jun 25 2019, 8:29 PM
epriestley requested review of D20619: Bump the remarkup cache version after JIRA/Asana rule changes.
Jun 25 2019, 7:56 PM
epriestley added a revision to T13291: Implement a "{src ...}" rule in Remarkup for referencing source files in Diffusion: D20619: Bump the remarkup cache version after JIRA/Asana rule changes.
Jun 25 2019, 7:55 PM · Remarkup, Diffusion
epriestley added a comment to D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.
  • Fix typo.
  • Fix out-of-date comment/logic around overseer tests.
Jun 25 2019, 7:45 PM
epriestley added a comment to D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.

This whole series of changes is motivated by "a PID file was out of date because of a reboot, and we tried to kill some other random process", right? Was there anything else that PID file tracking wasn't doing correctly?

Jun 25 2019, 7:43 PM
amckinley added a comment to D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.

This whole series of changes is motivated by "a PID file was out of date because of a reboot, and we tried to kill some other random process", right? Was there anything else that PID file tracking wasn't doing correctly?

Jun 25 2019, 6:59 PM
epriestley added a revision to T13320: Unannounced/unlogged AWS reboots are apparently routine procedure, not cosmic rays / ghosts: Unknown Object (Differential Revision).
Jun 25 2019, 5:50 PM · Phacility
epriestley added a comment to T13320: Unannounced/unlogged AWS reboots are apparently routine procedure, not cosmic rays / ghosts.

This incantation seems to work as an upstart job:

Jun 25 2019, 5:46 PM · Phacility
epriestley added a comment to T13320: Unannounced/unlogged AWS reboots are apparently routine procedure, not cosmic rays / ghosts.

I'm going to install an upstart task on secure004 and kick it a few times, some stuff might be sketchy until I figure that out.

Jun 25 2019, 5:17 PM · Phacility
epriestley added a comment to T5955: Refactor Conduit auth to be stateless, token-based, and support wire encodings.

Support multiple request encodings (likely BSON, protobuf, or messagepack). Leave JSON as the default, but in cases where messages can not be represented in JSON this gives us a plausible way forward.

Jun 25 2019, 4:55 PM · Restricted Project, Auth, Conduit
epriestley added a comment to T13328: Database dumps can buffer (?) too much data to hold in memory.

The stalled production backup process completed successfully after deploying the change.

Jun 25 2019, 3:54 PM · Restricted Project, Infrastructure, Phacility
epriestley added a comment to T13290: Clean up remaining "Autoclose" behaviors related to "One Revision, Many Commits".

See also PHI1318. The new behavior here has tightened our rules about which users we act as.

Jun 25 2019, 2:38 PM · Diffusion, Differential
epriestley committed rPccf207f20928: (stable) Limit the read buffer size in `bin/storage dump` (authored by epriestley).
(stable) Limit the read buffer size in `bin/storage dump`
Jun 25 2019, 2:17 PM
epriestley added a comment to T13328: Database dumps can buffer (?) too much data to hold in memory.

I'm going to try to sneak this out to the db tier to resolve things before the west coast wakes up, at least.

Jun 25 2019, 2:17 PM · Restricted Project, Infrastructure, Phacility
epriestley committed rPeaa60334ec16: Limit the read buffer size in `bin/storage dump` (authored by epriestley).
Limit the read buffer size in `bin/storage dump`
Jun 25 2019, 2:17 PM
epriestley closed D20617: Limit the read buffer size in `bin/storage dump`.
Jun 25 2019, 2:17 PM
D20617: Limit the read buffer size in `bin/storage dump` is now accepted and ready to land.
Jun 25 2019, 1:53 PM
epriestley requested review of D20617: Limit the read buffer size in `bin/storage dump`.
Jun 25 2019, 12:27 PM
epriestley added a revision to T13328: Database dumps can buffer (?) too much data to hold in memory: D20617: Limit the read buffer size in `bin/storage dump`.
Jun 25 2019, 12:25 PM · Restricted Project, Infrastructure, Phacility
epriestley added a comment to T13328: Database dumps can buffer (?) too much data to hold in memory.

PHP Fatal error: Out of memory (allocated 311164928) (tried to allocate 105988097 bytes) in /core/lib/libphutil/src/future/exec/ExecFuture.php on line 246

Jun 25 2019, 12:18 PM · Restricted Project, Infrastructure, Phacility
epriestley created T13328: Database dumps can buffer (?) too much data to hold in memory.
Jun 25 2019, 12:06 PM · Restricted Project, Infrastructure, Phacility
epriestley requested review of D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.
Jun 25 2019, 12:52 AM
epriestley added a revision to T13321: "bin/phd" may try to kill processes it does not own if the daemon PID logfiles on disk are out of date: D20616: Make "PhutilProcessQuery" detection of overseer processes more robust.
Jun 25 2019, 12:51 AM · Daemons, Phacility

Jun 24 2019

epriestley committed rPd1704f04d331: (stable) Consider "all account members are disabled" to be a permanent failure… (authored by epriestley).
(stable) Consider "all account members are disabled" to be a permanent failure…
Jun 24 2019, 11:13 PM
epriestley committed rPccfc74702f67: (stable) Make "bin/files" parsing of working set arguments more consistent (authored by epriestley).
(stable) Make "bin/files" parsing of working set arguments more consistent
Jun 24 2019, 11:13 PM
epriestley committed rPda0dfc057d64: Make "bin/files" parsing of working set arguments more consistent (authored by epriestley).
Make "bin/files" parsing of working set arguments more consistent
Jun 24 2019, 11:02 PM
epriestley closed D20614: Make "bin/files" parsing of working set arguments more consistent.
Jun 24 2019, 11:02 PM
epriestley closed T13326: "bin/files integrity" misparses file selection arguments as Resolved by committing rPda0dfc057d64: Make "bin/files" parsing of working set arguments more consistent.
Jun 24 2019, 11:02 PM · Files
D20614: Make "bin/files" parsing of working set arguments more consistent is now accepted and ready to land.
Jun 24 2019, 11:00 PM
epriestley committed rPa3397fb87613: Consider "all account members are disabled" to be a permanent failure when… (authored by epriestley).
Consider "all account members are disabled" to be a permanent failure when…
Jun 24 2019, 10:29 PM
epriestley closed D20613: Consider "all account members are disabled" to be a permanent failure when billing a Phortune subscription.
Jun 24 2019, 10:29 PM
epriestley closed T13327: When all payment account members are disabled, subscription workers fail infinitely as Resolved by committing rPa3397fb87613: Consider "all account members are disabled" to be a permanent failure when….
Jun 24 2019, 10:29 PM · Phortune, Phacility
D20613: Consider "all account members are disabled" to be a permanent failure when billing a Phortune subscription is now accepted and ready to land.
Jun 24 2019, 10:24 PM
epriestley requested review of D20614: Make "bin/files" parsing of working set arguments more consistent.
Jun 24 2019, 10:14 PM
epriestley added a revision to T13326: "bin/files integrity" misparses file selection arguments: D20614: Make "bin/files" parsing of working set arguments more consistent.
Jun 24 2019, 10:13 PM · Files
epriestley requested review of D20613: Consider "all account members are disabled" to be a permanent failure when billing a Phortune subscription.
Jun 24 2019, 9:51 PM
epriestley added a revision to T13327: When all payment account members are disabled, subscription workers fail infinitely: D20613: Consider "all account members are disabled" to be a permanent failure when billing a Phortune subscription.
Jun 24 2019, 9:50 PM · Phortune, Phacility
epriestley created T13327: When all payment account members are disabled, subscription workers fail infinitely.
Jun 24 2019, 9:33 PM · Phortune, Phacility
epriestley committed rP65bc481c91de: Remove "phd.pid-directory" configuration and stop passing "piddir" to daemons (authored by epriestley).
Remove "phd.pid-directory" configuration and stop passing "piddir" to daemons
Jun 24 2019, 6:29 PM
epriestley closed D20608: Remove "phd.pid-directory" configuration and stop passing "piddir" to daemons.
Jun 24 2019, 6:29 PM
epriestley committed rPHU7adfe4e4f4a3: Stop writing PID files in daemons (authored by epriestley).
Stop writing PID files in daemons
Jun 24 2019, 6:28 PM
epriestley closed D20607: Stop writing PID files in daemons.
Jun 24 2019, 6:28 PM
epriestley committed rP2498e373b955: Make "phd start" and "phd reload" use the process list, not PID files (authored by epriestley).
Make "phd start" and "phd reload" use the process list, not PID files
Jun 24 2019, 6:27 PM
epriestley closed D20606: Make "phd start" and "phd reload" use the process list, not PID files.
Jun 24 2019, 6:27 PM
epriestley committed rP08b9e70bea5c: Make "bin/phd status" report local daemons from the process list, not a mess of… (authored by epriestley).
Make "bin/phd status" report local daemons from the process list, not a mess of…
Jun 24 2019, 6:26 PM
epriestley closed T11037: `bin/phd status` is misleading about local / remote daemons as Resolved by committing rP08b9e70bea5c: Make "bin/phd status" report local daemons from the process list, not a mess of….
Jun 24 2019, 6:26 PM · Daemons, Restricted Project
epriestley closed D20604: Make "bin/phd status" report local daemons from the process list, not a mess of local/remote information.
Jun 24 2019, 6:26 PM
epriestley committed rPHUac8e57402236: Remove "PhutilDaemonOverseer->findRunningDaemons()" (authored by epriestley).
Remove "PhutilDaemonOverseer->findRunningDaemons()"
Jun 24 2019, 6:23 PM
epriestley closed D20603: Remove "PhutilDaemonOverseer->findRunningDaemons()".
Jun 24 2019, 6:23 PM
epriestley committed rPb99c240aa374: Deprecate "bin/phd ... --gently" and update documentation (authored by epriestley).
Deprecate "bin/phd ... --gently" and update documentation
Jun 24 2019, 6:16 PM
epriestley closed D20602: Deprecate "bin/phd ... --gently" and update documentation.
Jun 24 2019, 6:16 PM
epriestley committed rPd98bf8ef8ee6: Drive "phd stop" entirely from the process list, not PID files on disk (authored by epriestley).
Drive "phd stop" entirely from the process list, not PID files on disk
Jun 24 2019, 6:06 PM
epriestley closed D20601: Drive "phd stop" entirely from the process list, not PID files on disk.
Jun 24 2019, 6:06 PM
epriestley added a comment to D20601: Drive "phd stop" entirely from the process list, not PID files on disk.
  • Rebase to clear tests.
Jun 24 2019, 6:00 PM
Harbormaster failed remote builds in B23039: Diff 49165 for D20601: Drive "phd stop" entirely from the process list, not PID files on disk!
Jun 24 2019, 5:59 PM
epriestley added a comment to D20601: Drive "phd stop" entirely from the process list, not PID files on disk.
  • Wordsmithing: "any instance" -> "all instances"
Jun 24 2019, 5:58 PM
epriestley committed rPHUb6505e98bfbc: Formalize a "Query" class for looking at the process list (authored by epriestley).
Formalize a "Query" class for looking at the process list
Jun 24 2019, 5:53 PM
epriestley closed D20600: Formalize a "Query" class for looking at the process list.
Jun 24 2019, 5:53 PM
epriestley committed rPHUb9f35642c4e0: Parse remarkup tables with something like a real parser instead of regular… (authored by epriestley).
Parse remarkup tables with something like a real parser instead of regular…
Jun 24 2019, 5:51 PM
epriestley closed D20568: Parse remarkup tables with something like a real parser instead of regular expressions.
Jun 24 2019, 5:51 PM
epriestley committed rP09ecf49ee454: (stable) Require commit identities when editing commits to resolve an issue… (authored by epriestley).
(stable) Require commit identities when editing commits to resolve an issue…
Jun 24 2019, 5:51 PM
epriestley committed rP75c359835903: Require commit identities when editing commits to resolve an issue with audit… (authored by epriestley).
Require commit identities when editing commits to resolve an issue with audit…
Jun 24 2019, 5:50 PM
epriestley closed D20612: Require commit identities when editing commits to resolve an issue with audit actions not applying properly.
Jun 24 2019, 5:50 PM
D20612: Require commit identities when editing commits to resolve an issue with audit actions not applying properly is now accepted and ready to land.
Jun 24 2019, 5:47 PM
epriestley requested review of D20612: Require commit identities when editing commits to resolve an issue with audit actions not applying properly.
Jun 24 2019, 4:27 PM
kerberizer awarded T13323: Remove the "CAN_EDIT on a parent project implies CAN_EDIT on a child project" policy rule a Like token.
Jun 24 2019, 7:01 AM · Policy, Projects

Jun 22 2019

epriestley added a comment to T13306: Provide a mechanism for importing local disk file backups into the Phacility cluster.

See one followup in T13326. The "import from disk" part seems to have worked properly in production.

Jun 22 2019, 4:51 PM · Phacility, Files
epriestley closed T13325: Various internal APIs calls use the made up word "topographical" when they mean "topological" as Resolved.
Jun 22 2019, 4:50 PM · Infrastructure
epriestley created T13326: "bin/files integrity" misparses file selection arguments.
Jun 22 2019, 4:50 PM · Files
epriestley committed rPHUb675a06bf741: (stable) Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort… (authored by epriestley).
(stable) Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort…
Jun 22 2019, 4:06 PM
epriestley committed rPHUf5879cc6a9dc: Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort function (authored by epriestley).
Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort function
Jun 22 2019, 4:06 PM
epriestley closed D20611: Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort function.
Jun 22 2019, 4:05 PM
epriestley requested review of D20611: Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort function.
Jun 22 2019, 4:04 PM
epriestley added a revision to T13303: There is an extra or missing "array_reverse()" somewhere after recent transaction strength sorting changes: D20611: Allow "PhutilClassMapQuery" to sort with a PhutilSortVector sort function.
Jun 22 2019, 4:03 PM · Transactions
epriestley edited the content of Changelog.
Jun 22 2019, 2:55 PM
Herald added 1 auditor(s) for rARCdb4cd55d4673: Merge branch "master" into "experimental".: Cowboy Commits.
Merge branch "master" into "experimental".
Jun 22 2019, 2:40 PM
epriestley created an object: 2019 Week 25 (Late June).
Jun 22 2019, 2:39 PM
epriestley committed rPHU674d69718e88: (stable) Promote 2019 Week 25 (authored by epriestley).
(stable) Promote 2019 Week 25
Jun 22 2019, 2:38 PM
Herald added 1 auditor(s) for rARCfeb5f4d42c4f: (stable) Promote 2019 Week 25: Cowboy Commits.
(stable) Promote 2019 Week 25
Jun 22 2019, 2:38 PM
Herald added 1 auditor(s) for rP51cd3f097928: (stable) Promote 2019 Week 25: Cowboy Commits.
(stable) Promote 2019 Week 25
Jun 22 2019, 2:37 PM

Jun 21 2019

20after4 awarded T13291: Implement a "{src ...}" rule in Remarkup for referencing source files in Diffusion a Mountain of Wealth token.
Jun 21 2019, 9:06 PM · Remarkup, Diffusion
20after4 added a comment to D20539: Add a "{src ...}" Remarkup rule to provide a more flexible way to reference source files in Diffusion.

I've been wishing for this literally forever. If I could award more mountains of wealth tokens, I most certainly would!

Jun 21 2019, 9:06 PM
20after4 awarded D20539: Add a "{src ...}" Remarkup rule to provide a more flexible way to reference source files in Diffusion a Mountain of Wealth token.
Jun 21 2019, 9:05 PM
epriestley committed rPca56e8590a3d: Don't handle JIRA/Asana URIs with anchors or query parameters in a special way… (authored by epriestley).
Don't handle JIRA/Asana URIs with anchors or query parameters in a special way…
Jun 21 2019, 1:34 PM
epriestley closed D20592: Don't handle JIRA/Asana URIs with anchors or query parameters in a special way (with Doorkeeper).
Jun 21 2019, 1:34 PM
epriestley added a comment to D20592: Don't handle JIRA/Asana URIs with anchors or query parameters in a special way (with Doorkeeper).

I'm just going to land this as-is pending feedback on actual use cases, anticipating a followup to do parameter/anchor support if some reasonable #comment-123 URI exists in either external system. Then it will at least be easy for us to link-and-preserve-parameters or decline-to-link and we can figure out whatever else arises on a case-by-case basis.

Jun 21 2019, 1:34 PM
olasd edited the content of Organizations Using Phabricator.
Jun 21 2019, 8:20 AM