Cargo carshed during downloading crates for at least one dependency instance

[Xuanwo]

Problem

OpenDAL's unit test failed for:

https://github.com/apache/opendal/actions/runs/10110177395/job/27959585199?pr=4930

  ...
  Downloaded addr2line v0.22.0
  Downloaded addr v0.15.6
The application panicked (crashed).
Message:  at least one dependency instance
Location: /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/build.rs:749

  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
                                ⋮ 8 frames hidden ⋮                               
   9: core::panicking::panic_display::h2aa80c691b3dbc4e
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/panicking.rs:150
  10: core::panicking::panic_str::hc1b9be73e6642674
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/panicking.rs:134
  11: core::option::expect_failed::h87892de25a0c3562
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/option.rs:1988
  12: core::option::Option<T>::expect::h428e3b35ca79a3f9
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/option.rs:898
  13: guppy::graph::build::<impl guppy::graph::graph_impl::PackageLinkImpl>::new::h3863f8164196929d
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/build.rs:749
  14: guppy::graph::build::GraphBuildState::process_package::h8a346a1c5d9b15f8
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/build.rs:241
  15: guppy::graph::build::<impl guppy::graph::graph_impl::PackageGraph>::build::{{closure}}::hc438bf2dbb96ee3e
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/build.rs:52
  16: core::iter::adapters::map::map_try_fold::{{closure}}::hd8df88dc916c5a7b
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/adapters/map.rs:91
  17: core::iter::traits::iterator::Iterator::try_fold::h5093bf4cee9ecea2
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/traits/iterator.rs:2461
  18: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold::h829e166fa87c4d84
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/adapters/map.rs:117
  19: <core::iter::adapters::GenericShunt<I,R> as core::iter::traits::iterator::Iterator>::try_fold::h4f9664a3d199e75e
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/adapters/mod.rs:199
  20: <core::iter::adapters::GenericShunt<I,R> as core::iter::traits::iterator::Iterator>::fold::hc01ca0b4f8e554fd
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/mod.rs:378
  21: core::iter::traits::iterator::Iterator::for_each::hdff686b140e39f61
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/traits/iterator.rs:857
  22: <hashbrown::map::HashMap<K,V,S,A> as core::iter::traits::collect::Extend<(K,V)>>::extend::h5424fdd40cdae18a
      at /cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.14.0/src/map.rs:6455
  23: <std::collections::hash::map::HashMap<K,V,S> as core::iter::traits::collect::Extend<(K,V)>>::extend::h810536a12f039de1
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/std/src/collections/hash/map.rs:3038
  24: <std::collections::hash::map::HashMap<K,V,S> as core::iter::traits::collect::FromIterator<(K,V)>>::from_iter::hce919237945907d3
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/std/src/collections/hash/map.rs:3023
  25: core::iter::traits::iterator::Iterator::collect::ha45184fae5372a1e
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/traits/iterator.rs:2053
  26: <core::result::Result<V,E> as core::iter::traits::collect::FromIterator<core::result::Result<A,E>>>::from_iter::{{closure}}::h3da81aa463c43204
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/result.rs:1933
  27: core::iter::adapters::try_process::hbae863ee86ad2283
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/adapters/mod.rs:168
  28: <core::result::Result<V,E> as core::iter::traits::collect::FromIterator<core::result::Result<A,E>>>::from_iter::hcc02b9fef8fd556b
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/result.rs:1933
  29: core::iter::traits::iterator::Iterator::collect::h31f0ae4464531042
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/iter/traits/iterator.rs:2053
  30: guppy::graph::build::<impl guppy::graph::graph_impl::PackageGraph>::build::hfec2f6f9de59f83b
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/build.rs:53
  31: guppy::graph::graph_impl::PackageGraph::from_metadata::h720ea[849](https://github.com/apache/opendal/actions/runs/10110177395/job/27959585199?pr=4930#step:6:850)c3fbacbb
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/graph_impl.rs:69
  32: guppy::graph::graph_impl::PackageGraph::from_json::h24e4f5f5276ef6cc
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/guppy-0.17.1/src/graph/graph_impl.rs:84
  33: cargo_nextest::dispatch::BaseApp::new::ha4ccbed5a1d63f45
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cargo-nextest-0.9.59/src/dispatch.rs:923
  34: cargo_nextest::dispatch::AppOpts::exec::hbe60bbfac14d6938
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cargo-nextest-0.9.59/src/dispatch.rs:141
  35: cargo_nextest::dispatch::CargoNextestApp::exec::hf2701cea99fc61b2
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cargo-nextest-0.9.59/src/dispatch.rs:69
  36: cargo_nextest::main::hff3fa3ff73cc50fa
      at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cargo-nextest-0.9.59/src/main.rs:13
  37: core::ops::function::FnOnce::call_once::h2b7be2a27f97daa3
      at /rustc/cc66ad468955717ab92600c770da8c1601a4ff33/library/core/src/ops/function.rs:250
                                ⋮ 14 frames hidden ⋮                              

Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering.
Run with RUST_BACKTRACE=full to include source snippets.
Error: Process completed with exit code 101.

Steps

I can't reproduce this locally, but it can stablely show up in opendal CI.

Please try:

1. Clone OpenDAL
2. Trigger CI changes

Possible Solution(s)

No idea so far.

Notes

Rust related setup: https://github.com/apache/opendal/blob/main/.github/actions/setup/action.yaml

    - name: Setup rust related environment variables
      shell: bash
      run: |
        # Disable full debug symbol generation to speed up CI build and keep memory down
        # "1" means line tables only, which is useful for panic tracebacks.
        # About `force-frame-pointers`, here's the discussion history: https://github.com/apache/opendal/issues/3756
        echo "RUSTFLAGS=-C force-frame-pointers=yes -C debuginfo=1" >> $GITHUB_ENV
        # Enable backtraces
        echo "RUST_BACKTRACE=1" >> $GITHUB_ENV
        # Enable logging
        echo "RUST_LOG=opendal=trace" >> $GITHUB_ENV
        # Enable sparse index
        echo "CARGO_REGISTRIES_CRATES_IO_PROTOCOL=sparse" >> $GITHUB_ENV
        # Make sure rust has been setup
        cargo version

Version

cargo 1.80.0 (376290515 2024-07-16)

[xxchan]

This looks like nextest's issue instead of cargo issue. a similar one before nextest-rs/nextest#1090

[Xuanwo]

Oh, I never thought it could be related to nextest. Thanks a lot for pointing out. I will take a look.