Skip to content
This repository has been archived by the owner on Sep 9, 2020. It is now read-only.

command killed after 10s of no activity #1087

Closed
F21 opened this issue Aug 29, 2017 · 11 comments
Closed

command killed after 10s of no activity #1087

F21 opened this issue Aug 29, 2017 · 11 comments

Comments

@F21
Copy link

F21 commented Aug 29, 2017

What version of dep are you using (dep version)?

153953d

What dep command did you run?

$ dep init -v
Getting direct dependencies...
Checked 13 directories for packages.
Found 15 direct dependencies.
Root project is "gitlab.com/F21/someproject"
 9 transitively valid internal packages
 21 external packages imported from 15 projects
(0)   ✓ select (root)
(1)     ? attempt github.com/golang/protobuf with 4 pkgs; 1 versions to try
(1)         try github.com/golang/protobuf@master
(1)     ✓ select github.com/golang/protobuf@master w/5 pkgs
(2)     ? attempt github.com/hashicorp/go-multierror with 1 pkgs; 1 versions to try
(2)         try github.com/hashicorp/go-multierror@master
(2)     ✓ select github.com/hashicorp/go-multierror@master w/1 pkgs
(3)     ? attempt github.com/hashicorp/errwrap with 1 pkgs; 1 versions to try
(3)         try github.com/hashicorp/errwrap@master
(3)     ✓ select github.com/hashicorp/errwrap@master w/1 pkgs
(4)     ? attempt github.com/satori/go.uuid with 1 pkgs; 3 versions to try
(4)         try github.com/satori/[email protected]
(4)     ✓ select github.com/satori/[email protected] w/1 pkgs
(5)     ? attempt gitlab.com/F21/anotherthing with 1 pkgs; 1 versions to try
(5)         try gitlab.com/F21/anotherthing@master
(5)     ✓ select gitlab.com/F21/anotherthing@master w/3 pkgs
(6)     ? attempt github.com/grpc-ecosystem/grpc-opentracing with 1 pkgs; 1 versions to try
(6)         try github.com/grpc-ecosystem/grpc-opentracing@master
(6)     ✓ select github.com/grpc-ecosystem/grpc-opentracing@master w/1 pkgs
(7)     ? attempt github.com/oschwald/geoip2-golang with 1 pkgs; 5 versions to try
(7)         try github.com/oschwald/[email protected]
(7)     ✓ select github.com/oschwald/[email protected] w/1 pkgs
(8)     ? attempt github.com/eapache/go-resiliency with 1 pkgs; 2 versions to try
(8)         try github.com/eapache/[email protected]
(8)     ✓ select github.com/eapache/[email protected] w/1 pkgs
(9)     ? attempt golang.org/x/crypto with 1 pkgs; 1 versions to try
(9)         try golang.org/x/crypto@master
(9)     ✓ select golang.org/x/crypto@master w/2 pkgs
(10)  ? attempt google.golang.org/grpc with 3 pkgs; 20 versions to try
(10)      try google.golang.org/[email protected]
(10)  ✓ select google.golang.org/[email protected] w/15 pkgs
(11)  ? attempt google.golang.org/genproto with 1 pkgs; 3 versions to try
(11)      try google.golang.org/genproto@master
(11)  ✓ select google.golang.org/genproto@master w/1 pkgs
(12)  ? revisit github.com/golang/protobuf to add 1 pkgs
(12)    ✓ include 2 more pkgs from github.com/golang/protobuf@master
(12)  ? attempt github.com/Boostport/migration with 2 pkgs; 14 versions to try
(13)      try github.com/Boostport/[email protected]
(13)  ✓ select github.com/Boostport/[email protected] w/3 pkgs
(13)  ? attempt github.com/asaskevich/govalidator with 1 pkgs; 8 versions to try
(14)      try github.com/asaskevich/govalidator@v6
(14)  ✓ select github.com/asaskevich/govalidator@v6 w/1 pkgs
(14)  ? attempt github.com/lib/pq with 1 pkgs; 6 versions to try
(15)      try github.com/lib/pq@master
(15)  ✓ select github.com/lib/pq@master w/2 pkgs
(15)  ? attempt github.com/grpc-ecosystem/go-grpc-prometheus with 1 pkgs; 8 versions to try
(16)      try github.com/grpc-ecosystem/[email protected]
(16)  ✓ select github.com/grpc-ecosystem/[email protected] w/1 pkgs
(16)  ? attempt github.com/nbutton23/zxcvbn-go with 1 pkgs; 4 versions to try
(17)      try github.com/nbutton23/zxcvbn-go@master
(17)  ✓ select github.com/nbutton23/zxcvbn-go@master w/9 pkgs
(17)  ? attempt github.com/oschwald/maxminddb-golang with 1 pkgs; 7 versions to try
(18)      try github.com/oschwald/[email protected]
(18)  ✓ select github.com/oschwald/[email protected] w/1 pkgs
(18)  ? attempt golang.org/x/sys with 2 pkgs; 1 versions to try
(19)      try golang.org/x/sys@master
(19)  ✓ select golang.org/x/sys@master w/2 pkgs
(19)  ? attempt golang.org/x/net with 1 pkgs; 5 versions to try
(20)      try golang.org/x/net@master
(20)  ✓ select golang.org/x/net@master w/1 pkgs
(20)  ? attempt github.com/opentracing/opentracing-go with 1 pkgs; 27 versions to try
(21)      try github.com/opentracing/[email protected]
(21)  ✓ select github.com/opentracing/[email protected] w/2 pkgs
(21)  ? attempt gitlab.com/F21/somethingelse with 1 pkgs; 8 versions to try
(22)      try gitlab.com/F21/[email protected]
(22)  ✓ select gitlab.com/F21/[email protected] w/1 pkgs
(22)  ? attempt github.com/sirupsen/logrus with 1 pkgs; 46 versions to try
(23)      try github.com/sirupsen/[email protected]
(23)  ✓ select github.com/sirupsen/[email protected] w/1 pkgs
(23)  ? revisit golang.org/x/crypto to add 1 pkgs
(24)    ✓ include 1 more pkgs from golang.org/x/crypto@master
(23)  ? attempt github.com/pkg/errors with 1 pkgs; 11 versions to try
(25)      try github.com/pkg/[email protected]
(25)  ✓ select github.com/pkg/[email protected] w/1 pkgs
(24)  ? attempt github.com/Shopify/sarama with 1 pkgs; 24 versions to try
(26)      try github.com/Shopify/[email protected]
(26)  ✓ select github.com/Shopify/[email protected] w/1 pkgs
(25)  ? revisit github.com/eapache/go-resiliency to add 1 pkgs
(27)    ✓ include 1 more pkgs from github.com/eapache/[email protected]
(25)  ? revisit google.golang.org/grpc to add 1 pkgs
(28)    ✓ include 1 more pkgs from google.golang.org/[email protected]
(25)  ? revisit github.com/opentracing/opentracing-go to add 2 pkgs
(29)    ✓ include 3 more pkgs from github.com/opentracing/[email protected]
(25)  ? attempt github.com/prometheus/client_golang with 1 pkgs; 15 versions to try
(30)      try github.com/prometheus/[email protected]
(30)  ✓ select github.com/prometheus/[email protected] w/1 pkgs
(26)  ? revisit golang.org/x/net to add 3 pkgs
(31)    ✓ include 7 more pkgs from golang.org/x/net@master
(26)  ? revisit google.golang.org/grpc to add 1 pkgs
(32)    ✓ include 1 more pkgs from google.golang.org/[email protected]
(26)  ? attempt github.com/eapache/go-xerial-snappy with 1 pkgs; 1 versions to try
(33)      try github.com/eapache/go-xerial-snappy@master
(33)  ✓ select github.com/eapache/go-xerial-snappy@master w/1 pkgs
(27)  ? attempt github.com/hashicorp/go-cleanhttp with 1 pkgs; 1 versions to try
(34)      try github.com/hashicorp/go-cleanhttp@master
(34)  ✓ select github.com/hashicorp/go-cleanhttp@master w/1 pkgs
(28)  ? attempt golang.org/x/text with 2 pkgs; 1 versions to try
(35)      try golang.org/x/text@master
(35)  ✓ select golang.org/x/text@master w/9 pkgs
(29)  ? attempt github.com/cenkalti/backoff with 1 pkgs; 3 versions to try
(36)      try github.com/cenkalti/[email protected]
(36)  ✓ select github.com/cenkalti/[email protected] w/1 pkgs
(30)  ? attempt github.com/golang/snappy with 1 pkgs; 2 versions to try
(37)      try github.com/golang/snappy@master
(37)  ✓ select github.com/golang/snappy@master w/1 pkgs
(31)  ? attempt github.com/prometheus/common with 2 pkgs; 2 versions to try
(38)      try github.com/prometheus/common@master
(38)  ✓ select github.com/prometheus/common@master w/3 pkgs
(32)  ? attempt github.com/hashicorp/vault with 1 pkgs; 74 versions to try
(39)      try github.com/hashicorp/[email protected]
(39)  ✓ select github.com/hashicorp/[email protected] w/4 pkgs
(33)  ? attempt github.com/hashicorp/go-rootcerts with 1 pkgs; 1 versions to try
(40)      try github.com/hashicorp/go-rootcerts@master
(40)  ✓ select github.com/hashicorp/go-rootcerts@master w/1 pkgs
(34)  ? attempt github.com/mitchellh/go-homedir with 1 pkgs; 1 versions to try
(41)      try github.com/mitchellh/go-homedir@master
(41)  ✓ select github.com/mitchellh/go-homedir@master w/1 pkgs
(35)  ? attempt github.com/prometheus/client_model with 1 pkgs; 3 versions to try
(42)      try github.com/prometheus/client_model@master
(42)  ✓ select github.com/prometheus/client_model@master w/1 pkgs
(36)  ? attempt github.com/rcrowley/go-metrics with 1 pkgs; 3 versions to try
(43)      try github.com/rcrowley/go-metrics@master
(43)  ✓ select github.com/rcrowley/go-metrics@master w/1 pkgs
(37)  ? attempt github.com/mitchellh/mapstructure with 1 pkgs; 1 versions to try
(44)      try github.com/mitchellh/mapstructure@master
(44)  ✓ select github.com/mitchellh/mapstructure@master w/1 pkgs
(38)  ? attempt github.com/bsm/sarama-cluster with 1 pkgs; 18 versions to try
(45)      try github.com/bsm/[email protected]
(45)  ✓ select github.com/bsm/[email protected] w/1 pkgs
(39)  ? attempt github.com/sethgrid/pester with 1 pkgs; 2 versions to try
(46)      try github.com/sethgrid/pester@master
(46)  ✓ select github.com/sethgrid/pester@master w/1 pkgs
(40)  ? attempt github.com/prometheus/procfs with 1 pkgs; 2 versions to try
(47)      try github.com/prometheus/procfs@master
(47)  ✓ select github.com/prometheus/procfs@master w/2 pkgs
(41)  ? attempt github.com/matttproud/golang_protobuf_extensions with 1 pkgs; 6 versions to try
(48)      try github.com/matttproud/[email protected]
(48)  ✓ select github.com/matttproud/[email protected] w/1 pkgs
(42)  ? attempt github.com/eapache/queue with 1 pkgs; 4 versions to try
(49)      try github.com/eapache/[email protected]
(49)  ✓ select github.com/eapache/[email protected] w/1 pkgs
(43)  ? attempt github.com/hlandau/passlib with 1 pkgs; 11 versions to try
(50)      try github.com/hlandau/[email protected]
(50)  ✓ select github.com/hlandau/[email protected] w/1 pkgs
(44)  ? attempt gopkg.in/hlandau/easymetric.v1 with 1 pkgs; 1 versions to try
(51)      try gopkg.in/hlandau/[email protected]
(51)  ✓ select gopkg.in/hlandau/[email protected] w/1 pkgs
(45)  ? attempt gopkg.in/hlandau/measurable.v1 with 1 pkgs; 2 versions to try
(52)      try gopkg.in/hlandau/[email protected]
(52)  ✓ select gopkg.in/hlandau/[email protected] w/1 pkgs
(46)  ? attempt github.com/pierrec/lz4 with 1 pkgs; 3 versions to try
(53)      try github.com/pierrec/[email protected]
(53)  ✓ select github.com/pierrec/[email protected] w/1 pkgs
(47)  ? attempt github.com/fatih/structs with 1 pkgs; 3 versions to try
(54)      try github.com/fatih/[email protected]
(54)  ✓ select github.com/fatih/[email protected] w/1 pkgs
(48)  ? attempt github.com/beorn7/perks with 1 pkgs; 5 versions to try
(55)      try github.com/beorn7/perks@master
(55)  ✓ select github.com/beorn7/perks@master w/1 pkgs
(49)  ? attempt github.com/davecgh/go-spew with 1 pkgs; 3 versions to try
(56)      try github.com/davecgh/[email protected]
(56)  ✓ select github.com/davecgh/[email protected] w/1 pkgs
(50)  ? attempt github.com/grpc-ecosystem/go-grpc-middleware with 1 pkgs; 25 versions to try
(57)      try github.com/grpc-ecosystem/go-grpc-middleware@master
(57)  ✓ select github.com/grpc-ecosystem/go-grpc-middleware@master w/1 pkgs
(51)  ? attempt gopkg.in/hlandau/passlib.v1 with 5 pkgs; 11 versions to try
(58)      try gopkg.in/hlandau/[email protected]
(59)  ✗   gopkg.in/hlandau/passlib.v1 at v1.0.9 has problem subpkg(s):
(59)            gopkg.in/hlandau/passlib.v1/hash/sha2crypt is missing; required by github.com/hlandau/[email protected].   gopkg.in/hlandau/passlib.v1/abstract is missing; required by github.com/hlandau/[email protected].       gopkg.in/hlandau/passlib.v1/hash/bcrypt is missing; required by github.com/hlandau/[email protected].    gopkg.in/hlandau/passlib.v1/hash/bcryptsha256 is missing; required by github.com/hlandau/[email protected].        gopkg.in/hlandau/passlib.v1/hash/scrypt is missing; required by github.com/hlandau/[email protected].
(58)      try gopkg.in/hlandau/[email protected]
(58)  ✓ select gopkg.in/hlandau/[email protected] w/7 pkgs
(52)  ? revisit golang.org/x/crypto to add 1 pkgs
(59)    ✓ include 2 more pkgs from golang.org/x/crypto@master
(52)  ? attempt github.com/pierrec/xxHash with 1 pkgs; 3 versions to try
(60)      try github.com/pierrec/[email protected]
(60)  ✓ select github.com/pierrec/[email protected] w/1 pkgs
(53)  ? attempt github.com/hashicorp/hcl with 2 pkgs; 5 versions to try
(61)      try github.com/hashicorp/hcl@master
(61)  ✓ select github.com/hashicorp/hcl@master w/9 pkgs
  ✓ found solution with 126 packages from 53 projects

Solver wall times by segment:
         b-list-pkgs:  2m29.44503s
     b-list-versions:  2m8.911388s
              b-gmal: 2m2.6446055s
     b-source-exists:   4.7165984s
  b-deduce-proj-root:   878.6109ms
            new-atom:     26.009ms
         select-atom:    22.5037ms
             satisfy:    21.0028ms
            add-atom:     4.0004ms
         select-root:          2ms
               other:           0s

  TOTAL: 6m46.6717487s

  Using master as constraint for direct dep gitlab.com/F21/anotherthing
  Locking in master (3120f48) for direct dep gitlab.com/F21/anotherthing
  Locking in master (6bb64b3) for transitive dep github.com/hashicorp/go-rootcerts
  Locking in v1.0.1 (d96a009) for transitive dep gopkg.in/hlandau/measurable.v1
  Locking in v1.0.0 (6800482) for transitive dep github.com/eapache/go-resiliency
  Locking in master (553a641) for transitive dep github.com/golang/snappy
  Locking in master (a86a2d8) for transitive dep github.com/sethgrid/pester
  Using master as constraint for direct dep golang.org/x/crypto
  Locking in master (81e9090) for direct dep golang.org/x/crypto
  Locking in master (ee236bd) for transitive dep google.golang.org/genproto
  Locking in master (61f87aa) for transitive dep github.com/prometheus/common
  Locking in v1.0.2 (ded5959) for transitive dep github.com/eapache/queue
  Using master as constraint for direct dep golang.org/x/net
  Locking in master (66aacef) for direct dep golang.org/x/net
  Locking in v1.1.0 (346938d) for transitive dep github.com/davecgh/go-spew
  Using master as constraint for direct dep github.com/lib/pq
  Locking in master (e422674) for direct dep github.com/lib/pq
  Locking in v1.0.2 (1949ddb) for transitive dep github.com/opentracing/opentracing-go
  Using ^0.8.0 as constraint for direct dep github.com/pkg/errors
  Locking in v0.8.0 (645ef00) for direct dep github.com/pkg/errors
  Locking in v1.12.0 (c01858a) for transitive dep github.com/Shopify/sarama
  Using ^1.1.0 as constraint for direct dep github.com/satori/go.uuid
  Locking in v1.1.0 (879c588) for direct dep github.com/satori/go.uuid
  Locking in v1.0.3 (f006c2a) for transitive dep github.com/sirupsen/logrus
  Locking in master (6f38060) for transitive dep github.com/prometheus/client_model
  Using master as constraint for direct dep github.com/nbutton23/zxcvbn-go
  Locking in master (a22cb81) for direct dep github.com/nbutton23/zxcvbn-go
  Locking in master (bb955e0) for transitive dep github.com/eapache/go-xerial-snappy
  Locking in v1.1 (6b7015e) for transitive dep github.com/grpc-ecosystem/go-grpc-prometheus
  Locking in v1.0.8 (006f25b) for transitive dep gopkg.in/hlandau/passlib.v1
  Using ^1.5.2 as constraint for direct dep google.golang.org/grpc
  Locking in v1.5.2 (b3ddf78) for direct dep google.golang.org/grpc
  Using ^0.8.1 as constraint for direct dep github.com/Boostport/migration
  Locking in v0.8.1 (7111001) for direct dep github.com/Boostport/migration
  Locking in v2.1.8 (ccdc080) for transitive dep github.com/bsm/sarama-cluster
  Using ^1.1.0 as constraint for direct dep github.com/oschwald/geoip2-golang
  Locking in v1.1.0 (5b1dc16) for direct dep github.com/oschwald/geoip2-golang
  Locking in master (d0303fe) for transitive dep github.com/mitchellh/mapstructure
  Locking in master (645b33e) for transitive dep github.com/grpc-ecosystem/go-grpc-middleware
  Locking in master (6c130ee) for transitive dep github.com/grpc-ecosystem/grpc-opentracing
  Locking in v0.8.0 (c5b7fcc) for transitive dep github.com/prometheus/client_golang
  Using ^1.0.9 as constraint for direct dep github.com/hlandau/passlib
  Locking in v1.0.9 (933f1c3) for direct dep github.com/hlandau/passlib
  Locking in master (8f6b134) for transitive dep github.com/hashicorp/hcl
  Locking in master (ab9e364) for transitive dep golang.org/x/sys
  Locking in master (b8bc1bf) for transitive dep github.com/mitchellh/go-homedir
  Locking in master (e645f4e) for transitive dep github.com/prometheus/procfs
  Locking in master (3573b8b) for transitive dep github.com/hashicorp/go-cleanhttp
  Locking in v1.1.0 (61153c7) for transitive dep github.com/cenkalti/backoff
  Using master as constraint for direct dep github.com/hashicorp/go-multierror
  Locking in master (83588e7) for direct dep github.com/hashicorp/go-multierror
  Locking in master (7554cd9) for transitive dep github.com/hashicorp/errwrap
  Locking in v1.0.0 (3247c84) for transitive dep github.com/matttproud/golang_protobuf_extensions
  Locking in v1.0 (a720dfa) for transitive dep github.com/fatih/structs
  Using ^6.0.0 as constraint for direct dep github.com/asaskevich/govalidator
  Locking in v6 (4918b99) for direct dep github.com/asaskevich/govalidator
  Locking in master (18c65dd) for transitive dep golang.org/x/text
  Locking in master (1f30fe9) for transitive dep github.com/rcrowley/go-metrics
  Locking in master (4c0e845) for transitive dep github.com/beorn7/perks
  Locking in v0.1.1 (f051bb7) for transitive dep github.com/pierrec/xxHash
  Locking in v1.2.0 (d19f6d4) for transitive dep github.com/oschwald/maxminddb-golang
  Using ^0.5.0 as constraint for direct dep gitlab.com/F21/somethingelse
  Locking in v0.5.0 (eaa0aa6) for direct dep gitlab.com/F21/somethingelse
  Locking in v0.8.1 (8d76a41) for transitive dep github.com/hashicorp/vault
  Locking in v1.0.0 (1c17322) for transitive dep gopkg.in/hlandau/easymetric.v1
  Using master as constraint for direct dep github.com/golang/protobuf
  Locking in master (ab9f9a6) for direct dep github.com/golang/protobuf
  Locking in v1.0 (5c9560b) for transitive dep github.com/pierrec/lz4
Writing out github.com/Shopify/[email protected]
Writing out github.com/eapache/[email protected]
Writing out github.com/cenkalti/[email protected]
Writing out gopkg.in/hlandau/[email protected]
Writing out github.com/eapache/[email protected]
Writing out github.com/fatih/[email protected]
Writing out github.com/bsm/[email protected]
Writing out github.com/asaskevich/govalidator@v6
Writing out github.com/davecgh/[email protected]
Writing out github.com/pierrec/[email protected]
Writing out gitlab.com/F21/anotherthing@master
Writing out github.com/hashicorp/hcl@master
Writing out gitlab.com/F21/[email protected]
Writing out github.com/golang/protobuf@master
Writing out github.com/beorn7/perks@master
Writing out github.com/pkg/[email protected]
Writing out github.com/Boostport/[email protected]
Writing out golang.org/x/crypto@master
Writing out github.com/golang/snappy@master
Writing out github.com/pierrec/[email protected]
Writing out github.com/rcrowley/go-metrics@master
Writing out github.com/hashicorp/errwrap@master
Writing out github.com/prometheus/procfs@master
Writing out golang.org/x/net@master
Writing out github.com/satori/[email protected]
Writing out github.com/hashicorp/go-cleanhttp@master
Writing out github.com/grpc-ecosystem/go-grpc-middleware@master
Writing out github.com/hashicorp/[email protected]
Writing out github.com/prometheus/[email protected]
Writing out github.com/sethgrid/pester@master
Writing out github.com/hashicorp/go-multierror@master
Writing out github.com/eapache/go-xerial-snappy@master
Writing out github.com/hlandau/[email protected]
Writing out github.com/grpc-ecosystem/[email protected]
Writing out github.com/prometheus/client_model@master
Writing out github.com/sirupsen/[email protected]
Writing out github.com/hashicorp/go-rootcerts@master
Writing out github.com/mitchellh/mapstructure@master
Writing out github.com/nbutton23/zxcvbn-go@master
Writing out github.com/grpc-ecosystem/grpc-opentracing@master
Writing out github.com/prometheus/common@master
Writing out github.com/oschwald/[email protected]
Writing out github.com/matttproud/[email protected]
Writing out golang.org/x/sys@master
Writing out github.com/oschwald/[email protected]
Writing out github.com/mitchellh/go-homedir@master
Writing out google.golang.org/[email protected]
Writing out github.com/opentracing/[email protected]
Writing out golang.org/x/text@master
Writing out google.golang.org/genproto@master
Writing out gopkg.in/hlandau/[email protected]
Writing out gopkg.in/hlandau/[email protected]
Writing out github.com/lib/pq@master
Failed to write dep tree. The following errors occurred:
 *  failed to export google.golang.org/grpc: : command killed after 10s of no activity
 *  failed to export golang.org/x/sys: : command killed after 10s of no activity
 *  failed to export github.com/pierrec/lz4: : command killed after 10s of no activity
 *  failed to export golang.org/x/crypto: : command killed after 10s of no activity
 *  failed to export golang.org/x/text: : command killed after 10s of no activity
 *  failed to export google.golang.org/genproto: : command killed after 10s of no activity
 *  failed to export github.com/hashicorp/vault: : command killed after 10s of no activity
safe write of manifest and lock: error while writing out vendor tree: failed to write dep tree

What did you expect to see?

Dep should write the dependencies to the vendor tree correctly.

What did you see instead?

Dep fails because the command was killed. Maybe the default timeout should be higher as I am seeing this on my local machine and Gitlab CI.

@sdboyer
Copy link
Member

sdboyer commented Aug 30, 2017

yeah, i think we've just been too aggressive with these timeouts. i'm going to crank them up now.

@tamird
Copy link
Contributor

tamird commented Sep 1, 2017

What's the point of these timeouts at all? Under what circumstances is it expected that commands hang unexpectedly? Overzealous use of timeouts is a pretty good way to ensure your software has unexpected bugs.

@sdboyer
Copy link
Member

sdboyer commented Sep 1, 2017

@tamird i've been having the same thought this past week.

we originally instituted these timeouts at gophercon, when a ton of people were seeing dep hang for just...ten, fifteen minutes while trying to clone down repositories. in that moment, with it happening to a bunch of people, it seemed important to have something in place to terminate early. with every passing day, that seems increasingly wrongheaded.

it's important to note that they're not actually strictly timeouts - rather, they're "inactivity timeouts." we watch stdout/stderr, and if nothing emerges in the configured time period, then we kill the running command. however, most commands - especially when not attached to a tty - don't generate output, which means they end up behaving like plain timeouts.

but, yes, i think they're doing more harm than good, and am inclined to remove them.

@colek42
Copy link

colek42 commented Sep 6, 2017

I am seeing this in repos that have a lot of submodules.

@sdboyer
Copy link
Member

sdboyer commented Sep 6, 2017

@colek42 what OS?

@colek42
Copy link

colek42 commented Sep 6, 2017

@sdboyer we are seeing it on RHEL6/7 and WSL (Windows subsystem for linux). It looks like the number of objects in the repo is related to dep timing out. We have a large number of small assets in this repo.

image

how does go get handle this? From what I understand it just keeps waiting.

Possible solutions:

  1. Timeout should be an env variable
  2. Remove timeout and just wait
  3. Improve UX, can we emit progress?

The main use case for a timeout in dep, for us, would be in CI. There are plenty of ways to handle a timeout outside of dep. My vote would be to remove timeout and improve how we emit progress (if possible)

@andrewmaach

@andrewmaach
Copy link

Across our team we've had issues requiring us to run dep ensure several times to get it working. We've also had success running dep ensure -vendor-only as a workaround for those who dep ensure simply wouldn't work. Our Jenkins box sees the issue consistently (each branch running in its own go path) where the first build will fail due to timeouts. Usually the second or third try works.

Inspection of the path provided with git status appears normal.

Here's an sample failure from jenkins, running RHEL 6:

[project] Running shell script
+ dep ensure -v -vendor-only
Writing out github.com/Organization/common@master
Writing out github.com/StefanSchroeder/Golang-Ellipsoid@master
Writing out github.com/hailocab/go-hostpool@master
Writing out github.com/gorilla/schema@master
Writing out github.com/Organization/fms@master
Writing out github.com/Organization/internalgoreverseproxy@da99a25bc540a76a3fcc58df5a5a9e0564171f44
Writing out github.com/abbot/[email protected]
Writing out github.com/nu7hatch/gouuid@master
Writing out github.com/fatih/set@7b667b7b6a5d81d40a152d968b10e0e873fac404
Writing out github.com/go-redis/[email protected]
Writing out github.com/lib/pq@master
Writing out github.com/go-martini/martini@master
Writing out github.com/mattn/[email protected]
Writing out gopkg.in/yaml.v2@v2
Writing out github.com/martini-contrib/encoder@master
Writing out github.com/paulmach/[email protected]
Writing out github.com/mxk/go-imap@master
Writing out github.com/mitchellh/mapstructure@master
Writing out golang.org/x/net@master
Writing out golang.org/x/crypto@master
Writing out github.com/codegangsta/[email protected]
Writing out github.com/gocql/gocql@master
Writing out github.com/Organization/Migrate@master
Writing out github.com/nfnt/resize@master
Writing out github.com/the42/cartconvert@master
Writing out github.com/pebbe/zmq4@master
Writing out github.com/tealeg/[email protected]
Writing out github.com/martini-contrib/gzip@master
Writing out github.com/golang/snappy@master
Writing out github.com/TomiHiltunen/geohash-golang@master
Writing out gopkg.in/[email protected]
Writing out github.com/sfreiberg/gotwilio@master
Failed to write dep tree. The following errors occurred:
 *  failed to export github.com/Organization/internalgoreverseproxy: https://github.com/Organization/internalgoreverseproxy does not exist in the local cache and fetching failed: unable to get repository: Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy'...
remote: Counting objects: 7790, done.        
remote: Compressing objects:   4% (1/23)           
remote: Compressing objects:   8% (2/23)           
remote: Compressing objects:  13% (3/23)           
[...]      
remote: Compressing objects:  95% (22/23)           
remote: Compressing objects: 100% (23/23)           
remote: Compressing objects: 100% (23/23), done.        
Receiving objects:   0% (1/7790)   
Receiving objects:   1% (78/7790)   
Receiving objects:   2% (156/7790)   
Receiving objects:   3% (234/7790)   
Receiving objects:   4% (312/7790)   
Receiving objects:   5% (390/7790)   
Receiving objects:   6% (468/7790)   
Receiving objects:   7% (546/7790), 100.01 KiB | 123.00 KiB/s   
Receiving objects:   8% (624/7790), 100.01 KiB | 123.00 KiB/s   
[...]
Receiving objects:  98% (7687/7790), 32.49 MiB | 742.00 KiB/s   
Receiving objects:  99% (7713/7790), 32.49 MiB | 742.00 KiB/s   
remote: Total 7790 (delta 10), reused 15 (delta 5), pack-reused 7762        
Receiving objects: 100% (7790/7790), 32.49 MiB | 742.00 KiB/s   
Receiving objects: 100% (7790/7790), 32.83 MiB | 739.00 KiB/s, done.
Resolving deltas:   0% (0/3710)   
Resolving deltas:   1% (38/3710)   
Resolving deltas:   5% (188/3710)   
Resolving deltas:   7% (264/3710)   
[...]
Resolving deltas:  95% (3525/3710)   
Resolving deltas:  96% (3562/3710)   
Resolving deltas:  97% (3600/3710)   
Resolving deltas:  98% (3636/3710)   
Resolving deltas:  99% (3673/3710)   
Resolving deltas: 100% (3710/3710)   
Resolving deltas: 100% (3710/3710), done.
Checking connectivity... done.
Submodule 'auth/authadmin/packages/sharedjsrepo' ([email protected]:Organization/sharedjsrepo.git) registered for path 'auth/authadmin/packages/sharedjsrepo'
Submodule 'internalgoreverseproxyweb/authenticated/css/Font-Awesome' ([email protected]:FortAwesome/Font-Awesome.git) registered for path 'internalgoreverseproxyweb/authenticated/css/Font-Awesome'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/internalgoreverseproxyweb/authenticated/css/Font-Awesome'...
Submodule path 'auth/authadmin/packages/sharedjsrepo': checked out 'db50bf2df579a182dc675d88b4212dab81ba8eb2'
Submodule 'jslibrary1/libraries/jslibrary1' ([email protected]:AnalyticalGraphicsInc/jslibrary1.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1'
Submodule 'jslibrary1/libraries/jslibrary1-drawhelper' ([email protected]:Organization/jslibrary1-drawhelper.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-drawhelper'
Submodule 'jslibrary1/libraries/jslibrary1-navigation' ([email protected]:alberto-acevedo/jslibrary1-navigation.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation'
Submodule 'jslibrary1/libraries/html2canvas' ([email protected]:niklasvh/html2canvas.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas'
Submodule 'jslibrary1/libraries/progressbar.js' ([email protected]:kimmobrunfeldt/progressbar.js.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js'
Submodule 'locationpicker/libraries/Leaflet' ([email protected]:Leaflet/Leaflet.git) registered for path 'auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet'
Submodule 'locationpicker/libraries/Leaflet.EasyButton' ([email protected]:CliffCloud/Leaflet.EasyButton.git) registered for path 'auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton'
Submodule 'jslibrary3/libraries/jslibrary3' ([email protected]:proj4js/jslibrary3.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3'
Submodule 'moment/libraries/moment' ([email protected]:moment/moment.git) registered for path 'auth/authadmin/packages/sharedjsrepo/moment/libraries/moment'
Submodule 'vis/libraries/vis' ([email protected]:almende/vis.git) registered for path 'auth/authadmin/packages/sharedjsrepo/vis/libraries/vis'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1'...
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry the checkout with 'git checkout -f HEAD'

Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-drawhelper'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/moment/libraries/moment'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/vis/libraries/vis'...
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1': checked out 'bb4f85fa92ff0fd273b932ed1deda6d49e6bd370'
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-drawhelper': checked out '8715953bb272fa3f0ba4e66aef8aba7905cc4d9d'
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation': checked out '3366f0a77494b71f9a70a8427e46da3f8540d57c'
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas': checked out '83e9b85e1eb27993d48132af0fbfb4ee2f13c887'
Submodule 'src/fabric' (https://github.com/kangax/fabric.js.git) registered for path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-internalgoreverseproxy/auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric'...
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric': checked out '791c74a82ef0d838fd0bd81bf942f8630a9a4a8f'
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js': checked out 'af97480e8205aea4b8c44a74d8e9e71f77760a95'
Submodule path 'auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet': checked out '86e49f92ff934bcb5000c06305a7e90f988b4525'
Submodule path 'auth/authadmin/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton': checked out '3755da597236b8e927cdef4ddee65fe19a2c7823'
Submodule path 'auth/authadmin/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3': checked out 'e43d7d644564c09831587a5f01c911caae991d8c'
Submodule path 'auth/authadmin/packages/sharedjsrepo/moment/libraries/moment': checked out 'dd9cff0104c0dc3f114f54107397c59920e764cc'
Submodule path 'auth/authadmin/packages/sharedjsrepo/vis/libraries/vis': checked out '6de24a283c0ef549c616470f53aaaf0cb1488f82'
Submodule path 'internalgoreverseproxyweb/authenticated/css/Font-Awesome': checked out '48a7d9db28d450571a0882810d1591a2fadc39c6'

 *  failed to export github.com/Organization/fms: https://github.com/Organization/fms does not exist in the local cache and fetching failed: unable to get repository: Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms'...
remote: Counting objects: 9569, done.        
remote: Compressing objects:   7% (1/13)           
remote: Compressing objects:  15% (2/13)           
remote: Compressing objects:  23% (3/13)           
remote: Compressing objects:  30% (4/13)           
remote: Compressing objects:  38% (5/13)           
remote: Compressing objects:  46% (6/13)           
remote: Compressing objects:  53% (7/13)           
remote: Compressing objects:  61% (8/13)           
remote: Compressing objects:  69% (9/13)           
remote: Compressing objects:  76% (10/13)           
remote: Compressing objects:  84% (11/13)           
remote: Compressing objects:  92% (12/13)           
remote: Compressing objects: 100% (13/13)           
remote: Compressing objects: 100% (13/13), done.        
Receiving objects:   0% (1/9569)   
Receiving objects:   1% (96/9569)   
Receiving objects:   2% (192/9569)   
Receiving objects:   3% (288/9569)   
Receiving objects:   4% (383/9569)   
Receiving objects:   5% (479/9569)   
Receiving objects:   6% (575/9569)   
Receiving objects:   7% (670/9569)   
Receiving objects:   8% (766/9569), 140.01 KiB | 183.00 KiB/s   
Receiving objects:   9% (862/9569), 140.01 KiB | 183.00 KiB/s   
[...]
Receiving objects:  96% (9187/9569), 313.19 MiB | 702.00 KiB/s   
Receiving objects:  97% (9282/9569), 313.19 MiB | 702.00 KiB/s   
Receiving objects:  98% (9378/9569), 313.19 MiB | 702.00 KiB/s   
Receiving objects:  99% (9474/9569), 313.19 MiB | 702.00 KiB/s   
remote: Total 9569 (delta 3), reused 4 (delta 0), pack-reused 9555        
Receiving objects: 100% (9569/9569), 313.19 MiB | 702.00 KiB/s   
Receiving objects: 100% (9569/9569), 313.71 MiB | 724.00 KiB/s, done.
Resolving deltas:   0% (0/6071)   
Resolving deltas:   3% (232/6071)   
Resolving deltas:   4% (246/6071)   
Resolving deltas:   5% (332/6071)   
[...]
Resolving deltas:  98% (5954/6071)   
Resolving deltas:  99% (6011/6071)   
Resolving deltas: 100% (6071/6071)   
Resolving deltas: 100% (6071/6071), done.
Checking connectivity... done.
Submodule 'internaljslibrary3/packages/sharedjsrepo' ([email protected]:Organization/sharedjsrepo.git) registered for path 'internaljslibrary3/packages/sharedjsrepo'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo'...
Submodule path 'internaljslibrary3/packages/sharedjsrepo': checked out 'f03c34a5919043262fc2050b7b1294d9e627019d'
Submodule 'jslibrary1/libraries/jslibrary1-jslibrary4' ([email protected]:kaktus40/jslibrary1-jslibrary4.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-jslibrary4'
Submodule 'jslibrary1/libraries/jslibrary1' ([email protected]:AnalyticalGraphicsInc/jslibrary1.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1'
Submodule 'jslibrary1/libraries/jslibrary1-navigation' ([email protected]:alberto-acevedo/jslibrary1-navigation.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation'
Submodule 'jslibrary1/libraries/html2canvas' ([email protected]:niklasvh/html2canvas.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas'
Submodule 'jslibrary1/libraries/progressbar.js' ([email protected]:kimmobrunfeldt/progressbar.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js'
Submodule 'chat/libraries/converse.js' ([email protected]:jcbrand/converse.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/chat/libraries/converse.js'
Submodule 'csvparse/libraries/PapaParse' ([email protected]:mholt/PapaParse.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/csvparse/libraries/PapaParse'
Submodule 'dateslider/libraries/noUiSlider' ([email protected]:leongersen/noUiSlider.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/dateslider/libraries/noUiSlider'
Submodule 'fuzzymatch/libraries/Fuse' ([email protected]:krisk/Fuse.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/fuzzymatch/libraries/Fuse'
Submodule 'geom/libraries/geodesy' ([email protected]:chrisveness/geodesy.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/geom/libraries/geodesy'
Submodule 'geosearch/libraries/Leaflet.awesome-markers' ([email protected]:lvoogdt/Leaflet.awesome-markers.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/Leaflet.awesome-markers'
Submodule 'geosearch/libraries/tokml' ([email protected]:mapbox/tokml.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/tokml'
Submodule 'jquery/libraries/jquery' ([email protected]:jquery/jquery.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jquery/libraries/jquery'
Submodule 'lightgalleryjs/libraries/lg-fullscreen.js' (https://github.com/sachinchoolur/lg-fullscreen.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-fullscreen.js'
Submodule 'lightgalleryjs/libraries/lg-hash.js' (https://github.com/sachinchoolur/lg-hash.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-hash.js'
Submodule 'lightgalleryjs/libraries/lg-thumbnail.js' (https://github.com/sachinchoolur/lg-thumbnail.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-thumbnail.js'
Submodule 'lightgalleryjs/libraries/lg-video.js' (https://github.com/sachinchoolur/lg-video.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-video.js'
Submodule 'lightgalleryjs/libraries/lg-zoom.js' (https://github.com/sachinchoolur/lg-zoom.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-zoom.js'
Submodule 'lightgalleryjs/libraries/lightgallery.js' (https://github.com/sachinchoolur/lightgallery.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lightgallery.js'
Submodule 'locationpicker/libraries/Leaflet' ([email protected]:Leaflet/Leaflet.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet'
Submodule 'locationpicker/libraries/Leaflet.Deflate' ([email protected]:oliverroick/Leaflet.Deflate.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.Deflate'
Submodule 'locationpicker/libraries/Leaflet.EasyButton' ([email protected]:CliffCloud/Leaflet.EasyButton.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton'
Submodule 'locationpicker/libraries/Leaflet.EditableHandlers' ([email protected]:kartena/Leaflet.EditableHandlers.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EditableHandlers'
Submodule 'locationpicker/libraries/Leaflet.MarkerCluster.LayerSupport' ([email protected]:ghybs/Leaflet.MarkerCluster.LayerSupport.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.MarkerCluster.LayerSupport'
Submodule 'locationpicker/libraries/Leaflet.markercluster' ([email protected]:Leaflet/Leaflet.markercluster.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.markercluster'
Submodule 'jslibrary3/libraries/jslibrary3' ([email protected]:proj4js/jslibrary3.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3'
Submodule 'package1/libraries/package1bol' ([email protected]:spatialillusions/package1bol.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/package1/libraries/package1bol'
Submodule 'moment/libraries/moment' ([email protected]:moment/moment.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/moment/libraries/moment'
Submodule 'package2/libraries/hls.js' ([email protected]:dailymotion/hls.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/package2/libraries/hls.js'
Submodule 'vis/libraries/vis' ([email protected]:mikhailswift/vis.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/vis/libraries/vis'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-jslibrary4'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1'...
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry the checkout with 'git checkout -f HEAD'

Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/chat/libraries/converse.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/csvparse/libraries/PapaParse'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/dateslider/libraries/noUiSlider'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/fuzzymatch/libraries/Fuse'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/geom/libraries/geodesy'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/Leaflet.awesome-markers'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/tokml'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jquery/libraries/jquery'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-fullscreen.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-hash.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-thumbnail.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-video.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-zoom.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lightgallery.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.Deflate'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EditableHandlers'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.MarkerCluster.LayerSupport'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.markercluster'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/package1/libraries/package1bol'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/moment/libraries/moment'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/package2/libraries/hls.js'...
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/vis/libraries/vis'...
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-jslibrary2checked out '06b88fec000b0b12fd480441cea998dc9d8150c6'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1': checked out '34a648b0a66a493a2a42a98116cadc0ef6ab0b4a'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1-navigation': checked out 'e83aa261cf22d868781fbe87d5b8816e3d1de0a2'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas': checked out '83e9b85e1eb27993d48132af0fbfb4ee2f13c887'
Submodule 'src/fabric' (https://github.com/kangax/fabric.js.git) registered for path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric'
Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric'...
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/html2canvas/src/fabric': checked out '791c74a82ef0d838fd0bd81bf942f8630a9a4a8f'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/progressbar.js': checked out 'af97480e8205aea4b8c44a74d8e9e71f77760a95'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/chat/libraries/converse.js': checked out '49500a5f2c3ec39aa6cb1269c5b1d6bece2aa5fc'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/csvparse/libraries/PapaParse': checked out 'ed0f5795e4118c3ce6e609d9c52a3c9558e11647'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/dateslider/libraries/noUiSlider': checked out '9ff78133a9e8747b099325970ae4ca98f28d988e'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/fuzzymatch/libraries/Fuse': checked out '826833ada8b76d206866cb6d67e26c69dc9055e5'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/geom/libraries/geodesy': checked out '5c11801bbba6da2992603e0817a3c7391c4bcec0'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/Leaflet.awesome-markers': checked out '4dfeef6943d58bde2d8ea1213250f6e1aa49ef0f'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/geosearch/libraries/tokml': checked out '91c3fa5fb256ef74307847e21de53dbb1f043349'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jquery/libraries/jquery': checked out '7bb62bb3ae771fc57cc62ee14bd10d94680efb4f'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-fullscreen.js': checked out 'fe9bcfb66205695aecbf0479ef170c3da0cf821b'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-hash.js': checked out 'dbd4e42608d578d5c8bd5b5fc3b85e6cc8db8025'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-thumbnail.js': checked out 'cf37d846306a6dcd94181ceb6cd5252a2bea6c41'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-video.js': checked out 'e1ef85a726f4d021a072d722adf9cc2039b77693'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lg-zoom.js': checked out '7c41566cf26e508215f4cf80a62a11dc6a23be03'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/lightgalleryjs/libraries/lightgallery.js': checked out '1d8f126e3f493ebb5f821fdd496884b4321645ec'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet': checked out '1010451a666d5525430c4fbecb2bd870380a31e3'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.Deflate': checked out 'b02e33f50df2195b7be8ef592332d953034bc121'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EasyButton': checked out '3755da597236b8e927cdef4ddee65fe19a2c7823'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.EditableHandlers': checked out '0f0f039931ccd0a35372e0cc52f255953754cdc8'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.MarkerCluster.LayerSupport': checked out 'ae7deb7f2547ca47488ee8659cd2813319d3dc71'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/locationpicker/libraries/Leaflet.markercluster': checked out '7db30166f0be49ea20f778671ba1ed6ac047ddfd'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/jslibrary3/libraries/jslibrary3': checked out 'e43d7d644564c09831587a5f01c911caae991d8c'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/package1/libraries/package1': checked out 'a6caecc94f35a63004bf8419fc97bca4210ad8e6'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/moment/libraries/moment': checked out 'dd9cff0104c0dc3f114f54107397c59920e764cc'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/package2/libraries/hls.js': checked out '317dd3620f37b1999096fcb42b61582becb534dd'
Submodule path 'internaljslibrary3/packages/sharedjsrepo/vis/libraries/vis': checked out 'bc6330d612ef1b5e13156eee4ef8b129d01013f6'

grouped write of manifest, lock and vendor: error while writing out vendor tree: failed to write dep tree

@sdboyer
Copy link
Member

sdboyer commented Sep 6, 2017

  1. Timeout should be an env variable
  2. Remove timeout and just wait
  3. Improve UX, can we emit progress?

yeah, these are the exact set of possibilities we're considering. the third is the hardest, by far, but also probably the best in the long run. the first has a PR up at #1028, but my preference now is the second approach. there's a PR for that at #1110, but there are some issues with the approach there, as detailed in the issue. i'm not sure i can personally get to this this week or next, so help is very much welcome 😄

@sdboyer
Copy link
Member

sdboyer commented Sep 6, 2017

and...whew, @andrewmaach, that's quite a hefty bunch of submodules.

i'd be curious what the output is from the commands it recommended you run:

Cloning into '/data/jenkins/workspace/branch_workspace_directory/pkg/dep/sources/https---github.com-Organization-fms/internaljslibrary3/packages/sharedjsrepo/jslibrary1/libraries/jslibrary1'...
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry the checkout with 'git checkout -f HEAD'

@colek42
Copy link

colek42 commented Sep 7, 2017

@sdboyer I might be able to make a couple hours for this next week. The current plan is just to remove the code added at GopherCon. ref: #879

@sdboyer
Copy link
Member

sdboyer commented Sep 12, 2017

@colek42 i think we're probably going to get #1110 sorted pretty soon here, so it may not be necessary :)

zknill pushed a commit to zknill/dep that referenced this issue Oct 6, 2017
None of this is great, but this is the easiest immediate band-aid we
have.

Closes golang#1087.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants