concurrent calls to `git` cause issues with encrypted SSH keys #411

Thermi · 2016-05-10T13:48:15Z

Hello,

glide install does not work for me, because the Git repositories it needs to pull from are accessible over SSH. I am authenticating against it with my SSH key. The key's private key is encrypted. The concurrent calls that glide install makes, cause issues with the passphrase dialogue on the shell. Only the password for the first password request can be entered. Further attempts just echo the entered on the shell. Hitting enter just causes each error message to appear.
Please fix it. Decrypting my private key is not an option.

glide install
[WARN] The name listed in the config file (github.com/<private repo>) does not match the current location (.)
[INFO] Downloading dependencies. Please wait...
[INFO] Fetching updates for github.com/dgrijalva/jwt-go.
[INFO] Fetching updates for github.com/elazarl/goproxy.
[INFO] Fetching updates for github.com/go-kit/kit.
[INFO] Fetching updates for github.com/kr/logfmt.
[INFO] Fetching updates for github.com/go-stack/stack.
[INFO] Fetching updates for github.com/<private repo>
[INFO] Fetching updates for gopkg.in/mgo.v2.
[INFO] Fetching updates for github.com/<private repo>
[INFO] Fetching updates for github.com/go-logfmt/logfmt.
Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': Enter passphrase fo
r key '/home/thermi/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi
/.ssh/id_rsa_git': Enter passphrase for key '/home/thermi/.ssh/id_rsa_git': 


[WARN] Unable to checkout github.com/elazarl/goproxy
[ERROR] Update failed for github.com/elazarl/goproxy: Klone nach '<private path>/vendor/github.com/elazarl/goproxy' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128


[WARN] Unable to checkout github.com/<private repo>
[ERROR] Update failed for github.com/<private repo>: Klone nach '<private path>/vendor/<private repo>' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128


[WARN] Unable to checkout github.com/go-stack/stack
[ERROR] Update failed for github.com/go-stack/stack: Klone nach '<private path>/vendor/github.com/go-stack/stack' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128


[WARN] Unable to checkout github.com/go-kit/kit
[ERROR] Update failed for github.com/go-kit/kit: Klone nach '<private path>/vendor/github.com/go-kit/kit' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128

[WARN] Unable to checkout github.com/<private path>
[ERROR] Update failed for github.com/<private path>: Klone nach '<private path>/vendor/github.com/<private repo>' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128


[WARN] Unable to checkout github.com/dgrijalva/jwt-go
[ERROR] Update failed for github.com/dgrijalva/jwt-go: Klone nach '<private path>/vendor/github.com/dgrijalva/jwt-go' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128


[WARN] Unable to checkout github.com/go-logfmt/logfmt
[ERROR] Update failed for github.com/go-logfmt/logfmt: Klone nach '<private path>/vendor/github.com/go-logfmt/logfmt' ...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
: exit status 128
[INFO] Downloading dependencies. Please wait...
[INFO] Setting references.
[ERROR] Failed to set version on github.com/dgrijalva/jwt-go to 40bd0f3b4891a9d7f121bfb7b8e8b0525625e262: open /<private path>: no such file or directory
[ERROR] Failed to set version on github.com/elazarl/goproxy to 970f4ed8995ab98f808e4abf06f52660aeaec7a9: open <private path>: no such file or directory
[ERROR] Failed to set version on github.com/go-kit/kit to bf1de9351592667fd8739200fa355b6a5c53adbf: open <private path>: no su
ch file or directory
[ERROR] Failed to set version on github.com/go-logfmt/logfmt to a0ff333161fe5c2daed0ba52d1792bd3d2531b94: open<private path>: no such file or directory
[ERROR] Failed to set version on github.com/go-stack/stack to ac4c579c437a23e1a15814c867ccb82122fb383b: open <private path>: no such file or directory
[ERROR] Failed to set version on github.com/<private repo> to 44f2828e41e3c8fff13882990585b9705c5e944f: open<private path>: no 
such file or directory
[ERROR] Failed to set version on github.com/<private repo> to 328fbec767d031d163970074bdd5529c4252e966: open <private path>: no such file or directory
[INFO] Setting version for github.com/kr/logfmt to b84e30acd515aadc4b783ad4ff83aff3299bdfe0.

[INFO] Setting version for gopkg.in/mgo.v2 to b6e2fa371e64216a45e61072a96d4e3859f169da.
An Error has occurred

The text was updated successfully, but these errors were encountered:

mattfarina · 2016-05-10T14:36:59Z

I have a feeling this is due to concurrently calling Git.

sdboyer · 2016-05-17T10:21:59Z

@mattfarina seems like we should be able to add a flag for --serial-fetch or something, no?

I'll make a note of this in vsolver - I haven't implemented parallel fetch there yet, anyway, so the timing of this report is good.

nubunto · 2016-10-13T14:34:57Z

Also, not sure if this is related:

Glide version (glide --version): glide version 0.10.2

When I run glide install, the following happens:

[INFO] Lock file (glide.lock) does not exist. Performing update.
[INFO] Downloading dependencies. Please wait...
[INFO] Fetching updates for github.com/julienschmidt/httprouter.
[INFO] Fetching updates for github.com/pkg/errors.
[INFO] Fetching updates for github.com/thermeon/go-errors.
[INFO] Fetching updates for github.com/thermeon/go-logs.
Username for 'https://github.com': Username for 'https://github.com': nubunto
Password for 'https://[email protected]': Password for 'https://**MY PASSWORD GOES HERE AFTER I TYPE IT**@github.com': 
[WARN] Unable to checkout github.com/thermeon/go-logs
[ERROR] Update failed for github.com/thermeon/go-logs: Cloning into '/home/bruno/go-workspace/src/github.com/thermeon/forwarding-service/vendor/github.com/thermeon/go-logs'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://github.com/thermeon/go-logs/'
: exit status 128


[WARN] Unable to checkout github.com/thermeon/go-errors
[ERROR] Update failed for github.com/thermeon/go-errors: Cloning into '/home/bruno/go-workspace/src/github.com/thermeon/forwarding-service/vendor/github.com/thermeon/go-errors'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://github.com/thermeon/go-errors/'
: exit status 128
[ERROR] Failed to do initial checkout of config: Cloning into '/home/bruno/go-workspace/src/github.com/thermeon/forwarding-service/vendor/github.com/thermeon/go-logs'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://github.com/thermeon/go-logs/'
: exit status 128
Cloning into '/home/bruno/go-workspace/src/github.com/thermeon/forwarding-service/vendor/github.com/thermeon/go-errors'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://github.com/thermeon/go-errors/'
: exit status 128

nubunto · 2016-10-13T14:35:29Z

~~Some of those are private repositories, FWIW~~
All of the failing packages are private repositories.

ironcladlou · 2017-11-30T14:39:33Z

As a workaround, can you add the offending key(s) to your SSH agent?

hasufell · 2017-12-06T09:18:06Z

As a workaround, can you add the offending key(s) to your SSH agent?

That's quite a use case assumption. SSH agent is a security problem and not everyone wants to use it.

mattfarina · 2017-12-20T14:26:39Z

Does dep handle this well?

sdboyer · 2017-12-20T16:42:29Z

we don't right now, no. we do have a logical choke point we could exploit to enforce it relatively easily, but there hasn't been a direct complaint about it yet over there, so I've deferred it in favor of other things.

mattfarina · 2017-12-20T18:54:01Z

@sdboyer have you thought about what a good solution would be?

sdboyer · 2017-12-20T19:26:02Z

The only one i've been able to come up with doesn't necessarily qualify as "good" - probably more like "passable" 😄

We use the aforementioned choke point to throttle down all network activity to the point where all network calls are serialized. An environment variable (preferred) or flag (i'd rather not increase the surface area of the interface for this) then determines whether the throttling behavior is active.

luigi-riefolo · 2019-02-01T05:08:35Z

any update?

mattfarina added the bug label May 10, 2016

sdboyer mentioned this issue May 17, 2016

Allow control over parallel network activity sdboyer/gps#28

Open

sdboyer mentioned this issue Dec 1, 2016

Cannot use private repository #696

Closed

fabulous-gopher mentioned this issue Apr 21, 2017

Allow control over parallel network activity golang/dep#448

Closed

sdboyer mentioned this issue Dec 23, 2017

dep hangs when subcommands try to read from stdin golang/dep#1476

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

concurrent calls to `git` cause issues with encrypted SSH keys #411

concurrent calls to `git` cause issues with encrypted SSH keys #411

Thermi commented May 10, 2016 •

edited

Loading

mattfarina commented May 10, 2016

sdboyer commented May 17, 2016 •

edited

Loading

nubunto commented Oct 13, 2016 •

edited

Loading

nubunto commented Oct 13, 2016 •

edited

Loading

ironcladlou commented Nov 30, 2017

hasufell commented Dec 6, 2017

mattfarina commented Dec 20, 2017

sdboyer commented Dec 20, 2017

mattfarina commented Dec 20, 2017

sdboyer commented Dec 20, 2017

luigi-riefolo commented Feb 1, 2019

concurrent calls to git cause issues with encrypted SSH keys #411

concurrent calls to git cause issues with encrypted SSH keys #411

Comments

Thermi commented May 10, 2016 • edited Loading

mattfarina commented May 10, 2016

sdboyer commented May 17, 2016 • edited Loading

nubunto commented Oct 13, 2016 • edited Loading

nubunto commented Oct 13, 2016 • edited Loading

ironcladlou commented Nov 30, 2017

hasufell commented Dec 6, 2017

mattfarina commented Dec 20, 2017

sdboyer commented Dec 20, 2017

mattfarina commented Dec 20, 2017

sdboyer commented Dec 20, 2017

luigi-riefolo commented Feb 1, 2019

concurrent calls to `git` cause issues with encrypted SSH keys #411

concurrent calls to `git` cause issues with encrypted SSH keys #411

Thermi commented May 10, 2016 •

edited

Loading

sdboyer commented May 17, 2016 •

edited

Loading

nubunto commented Oct 13, 2016 •

edited

Loading

nubunto commented Oct 13, 2016 •

edited

Loading