Page MenuHomePhabricator
Feed Advanced Search

Jan 4 2016

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

@epriestley Thank you very much for this fix and the explanation!
It seems that this issue is now finally solved and can be closed.
Great start of a new year! ;)

Jan 4 2016, 12:45 PM · Git

Dec 30 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Today I`ve had some more time and investigated this issue a bit further.
I tried to debug this issue by using gdb and figured out that after a while the method DiffusionGitSSHWorkflow->waitForGitClient() in DiffusionGitUploadPackSSHWorkflow.php:35 loops forever:

[0x7f595b9d4208] stream_select(array(1)[0x3efe808], array(0)[0x3efe718], array(1)[0x40fb4c8], 1, 0) /home/build/phabricator/libphutil/src/channel/PhutilChannel.php:197
[0x7f595b9d3848] PhutilChannel::waitForActivity(array(1)[0x40fb588], array(1)[0x40fb588], array(0)[0x40fb5e8]) /home/build/phabricator/libphutil/src/channel/PhutilChannel.php:100
[0x7f595b9d3748] PhutilChannel::waitForAny(array(1)[0x40fb588]) /home/build/phabricator/phabricator/src/applications/diffusion/ssh/DiffusionGitSSHWorkflow.php:25
[0x7f595b9d34a0] DiffusionGitSSHWorkflow->waitForGitClient() /home/build/phabricator/phabricator/src/applications/diffusion/ssh/DiffusionGitUploadPackSSHWorkflow.php:35
[0x7f595b9d2ec8] DiffusionGitUploadPackSSHWorkflow->executeRepositoryOperations() /home/build/phabricator/phabricator/src/applications/diffusion/ssh/DiffusionSSHWorkflow.php:142
[0x7f595b9d28a0] DiffusionSSHWorkflow->execute(object[0x373c5c8]) /home/build/phabricator/phabricator/scripts/ssh/ssh-exec.php:267
Dec 30 2015, 4:08 PM · Git

Dec 21 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Same here... Sadly D14801 doesn't fix this issue.

Dec 21 2015, 8:27 AM · Git

Dec 15 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

As a temporary workaround our company currently uses direct checkout through the standard ssh server until we have a stable phabricator-ssh daemon available.
I hope this will be fixed soon...
Thanks anyway!

Dec 15 2015, 10:11 AM · Git

Dec 4 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Again I attached strace to narrow down the problem further.

Dec 4 2015, 1:02 PM · Git

Dec 3 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

The same here...

Dec 3 2015, 8:25 AM · Git

Dec 1 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Any news on this?

Dec 1 2015, 11:22 AM · Git

Nov 17 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Same as @cole... I've reported this issue with an already up to date OS and GIT:

build@ei-srv-l-141:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 14.04.3 LTS
Release:        14.04
Codename:       trusty
Nov 17 2015, 8:10 AM · Git

Nov 16 2015

VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

After playing around a while I found out that it seems the hang occurs only if another user concurrently does a git clone:

pasted_file (921×1 px, 220 KB)

Nov 16 2015, 2:38 PM · Git
VitaminCpp added a comment to T9724: "ssh-exec" sometimes hangs when git cloning larger repos .

Yes, the path to 'repo.git' looks like this: plink.exe git@<our_server> "git-upload-pack '/diffusion/TPTB/3RDPARTY/tbb.git'".
I've tried running sshd in debug mode, but the sshd is terminating on every new connection attempt, because it isn't running as a daemon.
The only logging output I got when my clone attempt gets stuck is the following on the server side:

Nov 16 11:03:02 ei-srv-l-141 sshd[64152]: Set /proc/self/oom_score_adj to 0
Nov 16 11:03:02 ei-srv-l-141 sshd[64152]: Connection from 192.168.192.179 port 28269 on 192.168.192.141 port 22
Nov 16 11:03:03 ei-srv-l-141 sshd[64152]: Postponed publickey for git from 192.168.192.179 port 28269 ssh2 [preauth]
Nov 16 11:03:04 ei-srv-l-141 sshd[64152]: Accepted publickey for git from 192.168.192.179 port 28269 ssh2: RSA c1:1d:81:e5:81:e7:0e:b3:cd:92:3b:fa:b9:22:73:ae
Nov 16 11:03:04 ei-srv-l-141 sshd[64152]: User child is on pid 64160
Nov 16 11:03:04 ei-srv-l-141 sshd[64160]: Starting session: forced-command (key-option) ''/home/build/phabricator/phabricator/bin/ssh-exec' '--phabricator-ssh-user' 'm.herzog' '--phabricator-ssh-key' '32'' for git from 192.168.192.179 port 28269
Nov 16 11:03:04 ei-srv-l-141 sudo:      git : TTY=unknown ; PWD=/home/git ; USER=build ; COMMAND=/usr/bin/git-upload-pack -- /var/repo/TPL/
Nov 16 11:03:04 ei-srv-l-141 sudo: pam_unix(sudo:session): session opened for user build by (uid=0)
Nov 16 11:03:07 ei-srv-l-141 sudo: pam_unix(sudo:session): session closed for user build
Nov 16 2015, 10:09 AM · Git

Nov 6 2015

VitaminCpp created T9724: "ssh-exec" sometimes hangs when git cloning larger repos .
Nov 6 2015, 10:26 AM · Git