Page MenuHomePhabricator

Curl failing on large import in cluster
Closed, ResolvedPublic

Description

I attempted to import not a huge repo, but not a small one either, and I saw it stall at importing with the following error thousands of times in the daemon logs

[2015-02-12 05:22:38] EXCEPTION: (PhutilProxyException) Error while executing task ID 12164 from queue. {>} (HTTPFutureCURLResponseStatus) [cURL/7] (http://172.30.0.67:80/api/diffusion.querycommits) <CURLE_COULDNT_CONNECT> The cURL library raised an error while making a request. You may be able to find more information about this error (error code: 7) on the cURL site: http://curl.haxx.se/libcurl/c/libcurl-errors.html#CURLECOULDNTCONNECT at [<phutil>/src/future/http/HTTPSFuture.php:404]
  #0 HTTPSFuture::isReady() called at [<phutil>/src/future/Future.php:39]
  #1 Future::resolve(NULL) called at [<phutil>/src/future/FutureProxy.php:36]
  #2 FutureProxy::resolve() called at [<phutil>/src/conduit/ConduitClient.php:57]
  #3 ConduitClient::callMethodSynchronous(string, array) called at [<phabricator>/src/applications/diffusion/query/DiffusionQuery.php:83]
  #4 DiffusionQuery::callConduitWithDiffusionRequest(PhabricatorUser, DiffusionGitRequest, string, array) called at [<phabricator>/src/applications/repository/worker/commitmessageparser/PhabricatorRepositoryCommitMessageParserWorker.php:29]
  #5 PhabricatorRepositoryCommitMessageParserWorker::parseCommit(PhabricatorRepository, PhabricatorRepositoryCommit) called at [<phabricator>/src/applications/repository/worker/PhabricatorRepositoryCommitParserWorker.php:44]
  #6 PhabricatorRepositoryCommitParserWorker::doWork() called at [<phabricator>/src/infrastructure/daemon/workers/PhabricatorWorker.php:91]
  #7 PhabricatorWorker::executeTask() called at [<phabricator>/src/infrastructure/daemon/workers/storage/PhabricatorWorkerActiveTask.php:158]
  #8 PhabricatorWorkerActiveTask::executeTask() called at [<phabricator>/src/infrastructure/daemon/workers/PhabricatorTaskmasterDaemon.php:19]
  #9 PhabricatorTaskmasterDaemon::run() called at [<phutil>/src/daemon/PhutilDaemon.php:91]
  #10 PhutilDaemon::execute() called at [<phutil>/scripts/daemon/exec/exec_daemon.php:111]

Task ID increments with each one

I think I might be flooding the server :D

Event Timeline

Mnkras raised the priority of this task from to Needs Triage.
Mnkras updated the task description. (Show Details)
Mnkras added a project: Phacility.
Mnkras added a subscriber: Mnkras.

I actually can't see anything in the repo, I just get that everywhere

Your instance just has an out-of-sync definition of repo001.phacility.net: I swapped the micro out for a full-power host but didn't re-sync all the device definitions.

So the shortest path to a fix is for me to click "Sync Services" in the admin console, although it might be good to improve tooling around this so it's harder to end up in this state.

epriestley claimed this task.

We should expand the tooling here eventually but I think it'll be a while before we really need it.