Improve responsiveness of repository tracking for large numbers of repositories
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	epriestley
	Mar 14 2014, 12:42 AM

Description

Implement automatic backoff for infrequently-updated repositories.
Fire diffusion.looksoon from arc land.
Possibly parallelize this stuff a bit, or make it easier to launch multiple PullLocal daemons and have them work together.

Revisions and Commits

rARC Arcanist
	D8783	rARC23c9e87fdfb0 After landing to a repository, hint that it should be updated
rP Phabricator
	D8782	rPc402d7d3076d Implement smart waits for rarely updated repositories
	D8785	rP5671c4b27669 Make PullLocal daemon more flexible and transparent about scheduling
	D8781	rP417056932e62 Make discovery slightly cheaper in the common case
	D8780	rP118c696f727a Separate repository updates from the pull daemon

Event Timeline

epriestley created this task.Mar 14 2014, 12:42 AM

epriestley raised the priority of this task from to Normal.

epriestley updated the task description. (Show Details)

epriestley added a project: Diffusion.

epriestley added subscribers: epriestley, zeeg.

@dctrwatson hit a case where the pull daemon appeared to cache a repository configuration for 34 minutes. Although we reload repositories periodically, we should probably reload them explicitly before pulling too, to guarantee the smallest cache window we reasonably can. This isn't particularly expensive.

mahngiel added a subscriber: mahngiel.Mar 27 2014, 4:22 PM

charles added a subscriber: charles.Apr 15 2014, 9:00 PM

epriestley edited this Maniphest Task.Apr 15 2014, 11:16 PM

epriestley edited this Maniphest Task.Apr 16 2014, 1:37 AM

epriestley edited this Maniphest Task.Apr 16 2014, 1:53 AM