I'm seeing a lot of errors in my Nginx log. Eventually the errors cause the PHP-FPM worker process to crash, which means occasionally page requests result in Nginx returning 503. Here's a portion of the error log:
```
2013/11/25 00:24:23 [error] 11817#0: *12471 FastCGI sent in stderr: "PHP message: [2013-11-25 16:24:23] EXCEPTION: (Exception) Ref "origin/origin/HEAD" is ambiguous or does not exist. at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:655]
PHP message: #0 DiffusionRequest::queryStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:320]
PHP message: #1 DiffusionRequest::getStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_readmequery_Method.php:58]
PHP message: #2 ConduitAPI_diffusion_readmequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #5 ConduitCall::executeMethod() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:90]
PHP message: #6 ConduitCall::execute() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/query/DiffusionQuery.php:70]
PHP message: #7 DiffusionQuery::callConduitWithDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.readmequery, Array { paths => Array of size 19 starting with: { 0 => Array of size 8 starting with: { fullPath => .hgignore } } }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message: #8
2013/11/25 00:46:59 [error] 11817#0: *12553 FastCGI sent in stderr: "PHP message: [2013-11-25 16:46:59] ERROR 8: Undefined offset: 4 at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:106]
PHP message: #0 ConduitAPI_diffusion_browsequery_Method::getGitResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:165]
PHP message: #1 ConduitAPI_diffusion_abstractquery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:28]
PHP message: #2 ConduitAPI_diffusion_browsequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #5 ConduitCall::executeMethod() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:90]
PHP message: #6 ConduitCall::execute() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/query/DiffusionQuery.php:70]
PHP message: #7 DiffusionQuery::callConduitWithDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.browsequery, Array of size 2 starting with: { path => null }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message:
2013/11/25 00:46:59 [error] 11817#0: *12553 FastCGI sent in stderr: "thDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.browsequery, Array of size 2 starting with: { path => null }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message: #8 DiffusionController::callConduitWithDiffusionRequest(diffusion.browsequery, Array of size 2 starting with: { path => null }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionBrowseMainController.php:22]
PHP message: #9 DiffusionBrowseMainController::processRequest() called at [/srv/www/redpointsoftware.com.au/code/phabricator/webroot/index.php:84]
PHP message: [2013-11-25 16:46:59] ERROR 8: Undefined offset: 2 at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:106]
PHP message: #0 ConduitAPI_diffusion_browsequery_Method::getGitResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:165]
PHP message: #1 ConduitAPI_diffusion_abstractquery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:28]
PHP message: #2 ConduitAPI_diffusion_browsequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricato
2013/11/25 00:46:59 [error] 11817#0: *12553 FastCGI sent in stderr: "ect ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #5 ConduitCall::executeMethod() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:90]
PHP message: #6 ConduitCall::execute() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/query/DiffusionQuery.php:70]
PHP message: #7 DiffusionQuery::callConduitWithDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.browsequery, Array of size 2 starting with: { path => null }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message: #8 DiffusionController::callConduitWithDiffusionRequest(diffusion.browsequery, Array of size 2 starting with: { path => null }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionBrowseMainController.php:22]
PHP message: #9 DiffusionBrowseMainController::processRequest() called at [/srv/www/redpointsoftware.com.au/code/phabricator/webroot/index.php:84]" while reading response header from upstream, client: 127.0.0.1, server: code.redpointsoftware.com.au, request: "GET /diffusion/SUB/browse/master/;3ee21521b3a00d3a87388be427da86566c799f3c HTTP/1.0", upstream: "fastcgi://unix:/tmp/php-fpm-code.redpointsoftware.com.au.sock:", host: "code.redpointsoftware.com.au"
2013/11/25 01:36:06 [error] 11817#0: *12834 FastCGI sent in stderr: "PHP message: [2013-11-25 17:36:05] EXCEPTION: (Exception) Ref "origin/origin/master" is ambiguous or does not exist. at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:655]
PHP message: #0 DiffusionRequest::queryStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:320]
PHP message: #1 DiffusionRequest::getStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_readmequery_Method.php:58]
PHP message: #2 ConduitAPI_diffusion_readmequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #5 ConduitCall::executeMethod() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:90]
PHP message: #6 ConduitCall::execute() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/query/DiffusionQuery.php:70]
PHP message: #7 DiffusionQuery::callConduitWithDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.readmequery, Array { paths => Array of size 11 starting with: { 0 => Array of size 8 starting with: { fullPath => .arcconfig } } }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message:
2013/11/25 02:11:06 [error] 11817#0: *12982 FastCGI sent in stderr: "PHP message: [2013-11-25 18:11:06] EXCEPTION: (Exception) Ref "origin/origin/HEAD" is ambiguous or does not exist. at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:655]
PHP message: #0 DiffusionRequest::queryStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/request/DiffusionRequest.php:320]
PHP message: #1 DiffusionRequest::getStableCommitName() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_readmequery_Method.php:58]
PHP message: #2 ConduitAPI_diffusion_readmequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #4 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #5 ConduitCall::executeMethod() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:90]
PHP message: #6 ConduitCall::execute() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/query/DiffusionQuery.php:70]
PHP message: #7 DiffusionQuery::callConduitWithDiffusionRequest(Object PhabricatorUser, Object DiffusionGitRequest, diffusion.readmequery, Array { paths => Array of size 10 starting with: { 0 => Array of size 8 starting with: { fullPath => .gitignore } } }) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/controller/DiffusionController.php:171]
PHP message: #8
2013/11/25 02:49:24 [error] 11818#0: *13114 FastCGI sent in stderr: "PHP message: [2013-11-25 18:49:24] EXCEPTION: (CommandException) Command failed with error #128!
COMMAND
git cat-file -t '10b132b28ae8687ea01d4bdab815b2dbcac0493c':'Protogame'
STDOUT
(empty)
STDERR
fatal: git cat-file 10b132b28ae8687ea01d4bdab815b2dbcac0493c:Protogame: bad file
at [/srv/www/redpointsoftware.com.au/code/libphutil/src/future/exec/ExecFuture.php:349]
PHP message: #0 ExecFuture::resolvex() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/repository/storage/PhabricatorRepository.php:245]
PHP message: #1 PhabricatorRepository::execxLocalCommand(cat-file -t %s:%s, 10b132b28ae8687ea01d4bdab815b2dbcac0493c, Protogame) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:48]
PHP message: #2 ConduitAPI_diffusion_browsequery_Method::getGitResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:165]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:28]
PHP message: #4 ConduitAPI_diffusion_browsequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #5 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #6 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
PHP message: #7 ConduitCall::exec
2013/11/25 03:26:23 [error] 11818#0: *13289 FastCGI sent in stderr: "PHP message: [2013-11-25 19:26:23] EXCEPTION: (CommandException) Command failed with error #128!
COMMAND
git cat-file -t '0ccec247333ccaacb64fc66a6c159003dd3049a7':'Protogame'
STDOUT
(empty)
STDERR
fatal: git cat-file 0ccec247333ccaacb64fc66a6c159003dd3049a7:Protogame: bad file
at [/srv/www/redpointsoftware.com.au/code/libphutil/src/future/exec/ExecFuture.php:349]
PHP message: #0 ExecFuture::resolvex() called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/repository/storage/PhabricatorRepository.php:245]
PHP message: #1 PhabricatorRepository::execxLocalCommand(cat-file -t %s:%s, 0ccec247333ccaacb64fc66a6c159003dd3049a7, Protogame) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:48]
PHP message: #2 ConduitAPI_diffusion_browsequery_Method::getGitResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:165]
PHP message: #3 ConduitAPI_diffusion_abstractquery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_browsequery_Method.php:28]
PHP message: #4 ConduitAPI_diffusion_browsequery_Method::getResult(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/diffusion/conduit/ConduitAPI_diffusion_abstractquery_Method.php:157]
PHP message: #5 ConduitAPI_diffusion_abstractquery_Method::execute(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/method/ConduitAPIMethod.php:68]
PHP message: #6 ConduitAPIMethod::executeMethod(Object ConduitAPIRequest) called at [/srv/www/redpointsoftware.com.au/code/phabricator/src/applications/conduit/call/ConduitCall.php:163]
```