Page MenuHomePhabricator
Create Task
Maniphest T6742

Daemon tasks not processing, repository reports "Fully Imported"
Closed, WontfixPublic
Actions

Assigned To
beeerd
Authored By
beeerd
Dec 12 2014, 7:21 PM
Tags
Referenced Files
F249618: 3.png
Dec 12 2014, 7:21 PM
F249616: 2.png
Dec 12 2014, 7:21 PM
F249614: 1.png
Dec 12 2014, 7:21 PM
Subscribers
beeerd
epriestley
pmepablo

Description

This is a new Phabricator install, and I'm afraid I've misconfigured something or incorrectly set permissions somewhere. For a while, daemons were running as root, I've since fixed the issue and corrected perms on the /var/tmp/run and /var/tmp/pid dirs, but seeing 0 tasks being processed. New tasks keep entering the queue as I try importing new repositories, but no commit logs are ever imported.

I've tried restarting the daemons a number of times.

I've scoured through the issue history and documentation but can't seem to find anything relevant...Thanks!

phd log: http://hastebin.com/igoxewewis.xml

PhabricatorTaskmasterDaemon debug log output: http://hastebin.com/adibinofan.xml

output from "bin/repository --trace update TIGER": http://hastebin.com/osaqugopub.xml

1.png (540×1 px, 113 KB)

2.png (718×1 px, 117 KB)

3.png (296×1 px, 46 KB)

Revisions and Commits

rP Phabricator
D10998rP7d9bda59a6bf Prevent worker queue leases from exceeding 64 characters

Related Objects

Event Timeline

beeerd created this task.Dec 12 2014, 7:21 PM
beeerd raised the priority of this task from to Needs Triage.
beeerd updated the task description. (Show Details)
beeerd added a project: Phabricator.
beeerd added a subscriber: beeerd.
chad edited projects, added Diffusion; removed Phabricator.Dec 12 2014, 8:54 PM
beeerd updated the task description. (Show Details)Dec 12 2014, 8:58 PM
pmepablo added a subscriber: pmepablo.EditedDec 15 2014, 8:44 PM

This could be related to T6608. We are having the same issue when someone issues a commit with a long summary.

[15-Dec-2014 15:12:15] [2014-12-15 15:12:15] EXCEPTION: (PhutilProxyException) Error while executing task ID 20481 from queue. {>} (AphrontQueryException) #1406: Data too long for column 'summary' at row 1 at [<phutil>/src/aphront/storage/connection/mysql/AphrontBaseMySQLDatabaseConnection.php:308]
[15-Dec-2014 15:12:15]   #0 AphrontBaseMySQLDatabaseConnection::throwQueryCodeException(integer, string) called at [<phutil>/src/aphront/storage/connection/mysql/AphrontBaseMySQLDatabaseConnection.php:275]
[15-Dec-2014 15:12:15]   #1 AphrontBaseMySQLDatabaseConnection::throwQueryException(mysqli) called at [<phutil>/src/aphront/storage/connection/mysql/AphrontBaseMySQLDatabaseConnection.php:181]
[15-Dec-2014 15:12:15]   #2 AphrontBaseMySQLDatabaseConnection::executeRawQuery(string) called at [<phutil>/src/xsprintf/queryfx.php:6]
[15-Dec-2014 15:12:15]   #3 queryfx(AphrontMySQLiDatabaseConnection, string, string, string, string, string)
[15-Dec-2014 15:12:15]   #4 call_user_func_array(string, array) called at [<phutil>/src/aphront/storage/connection/AphrontDatabaseConnection.php:26]
[15-Dec-2014 15:12:15]   #5 AphrontDatabaseConnection::query(string, string, string, string, string) called at [<phabricator>/src/infrastructure/storage/lisk/LiskDAO.php:1112]
[15-Dec-2014 15:12:15]   #6 LiskDAO::update() called at [<phabricator>/src/infrastructure/storage/lisk/LiskDAO.php:1041]
[15-Dec-2014 15:12:15]   #7 LiskDAO::save() called at [<phabricator>/src/applications/repository/storage/PhabricatorRepositoryCommit.php:169]
[15-Dec-2014 15:12:15]   #8 PhabricatorRepositoryCommit::save() called at [<phabricator>/src/applications/repository/worker/commitmessageparser/PhabricatorRepositoryCommitMessageParserWorker.php:80]
[15-Dec-2014 15:12:15]   #9 PhabricatorRepositoryCommitMessageParserWorker::updateCommitData(DiffusionCommitRef) called at [<phabricator>/src/applications/repository/worker/commitmessageparser/PhabricatorRepositoryGitCommitMessageParserWorker.php:15]
[15-Dec-2014 15:12:15]   #10 PhabricatorRepositoryGitCommitMessageParserWorker::parseCommit(PhabricatorRepository, PhabricatorRepositoryCommit) called at [<phabricator>/src/applications/repository/worker/PhabricatorRepositoryCommitParserWorker.php:44]
[15-Dec-2014 15:12:15]   #11 PhabricatorRepositoryCommitParserWorker::doWork() called at [<phabricator>/src/infrastructure/daemon/workers/PhabricatorWorker.php:87]
[15-Dec-2014 15:12:15]   #12 PhabricatorWorker::executeTask() called at [<phabricator>/src/infrastructure/daemon/workers/storage/PhabricatorWorkerActiveTask.php:156]
[15-Dec-2014 15:12:15]   #13 PhabricatorWorkerActiveTask::executeTask() called at [<phabricator>/src/infrastructure/daemon/workers/PhabricatorTaskmasterDaemon.php:19]
[15-Dec-2014 15:12:15]   #14 PhabricatorTaskmasterDaemon::run() called at [<phutil>/src/daemon/PhutilDaemon.php:91]
[15-Dec-2014 15:12:15]   #15 PhutilDaemon::execute() called at [<phutil>/scripts/daemon/exec/exec_daemon.php:111]

If you look at the /daemon console you may notice several queued tasks related to these commits.

beeerd added a comment.EditedDec 16 2014, 8:03 PM

I don't think so, I'm seeing this on every repo and I don't see any tracebacks in debug logs. The workers on this install have never processed a single task.

beeerd added a project: Daemons.Dec 16 2014, 8:14 PM
beeerd added a comment.Dec 16 2014, 8:19 PM

Perhaps I'm running into T6456?

The debug output there looks more similar to what I'm seeing: no errors, but 0 leasedtasks being processed.

beeerd closed this task as Wontfix.EditedDec 16 2014, 11:14 PM
beeerd claimed this task.

Confirmed this is a duplicate of D10998

epriestley added a revision: D10998: Prevent worker queue leases from exceeding 64 characters.Dec 16 2014, 11:14 PM
epriestley mentioned this in T6768: Worker queue lease names are unwieldy and could be better implemented.Dec 16 2014, 11:21 PM
epriestley added a subscriber: epriestley.

I filed T6768 to eventually produce a cleaner fix for this issue; D10998 should work, it's just not very elegant.

epriestley mentioned this in T6456: Daemon worker queue not working.Dec 16 2014, 11:26 PM
epriestley added a commit: rP7d9bda59a6bf: Prevent worker queue leases from exceeding 64 characters.Dec 17 2014, 7:10 PM
Phabricator · Built by Phacility