Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🤖 [master] Bump the Downloads stdlib from f97c72f to 246504e #51046

Conversation

DilumAluthgeBot
Copy link
Contributor

@DilumAluthgeBot DilumAluthgeBot commented Aug 25, 2023

Stdlib: Downloads
URL: https://github.com/JuliaLang/Downloads.jl.git
Stdlib branch: master
Julia branch: master
Old commit: f97c72f
New commit: 246504e
Julia version: 1.11.0-DEV
Downloads version: 1.6.0(It's okay that it doesn't match)
Bump invoked by: @DilumAluthge
Powered by: BumpStdlibs.jl

Diff: JuliaLang/Downloads.jl@f97c72f...246504e

$ git log --oneline f97c72f..246504e
246504e add a small precompile workload (#226)
3ed0f08 Document how to bypass the 20-second timeout (#222)

@DilumAluthge
Copy link
Member

cc: @StefanKarpinski

@DilumAluthge DilumAluthge added stdlib Julia's standard library merge me PR is reviewed. Merge when all tests are passing labels Aug 25, 2023
@DilumAluthge DilumAluthge removed the merge me PR is reviewed. Merge when all tests are passing label Aug 25, 2023
@DilumAluthge
Copy link
Member

DilumAluthge commented Aug 25, 2023

@StefanKarpinski Any idea why the tests are failing?

Error in testset NetworkOptions:
Test Failed at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-HL2F7YQ3XH.0/build/default-honeycrisp-HL2F7YQ3XH-0/julialang/julia-master/julia-1e7e80d143/share/julia/stdlib/v1.11/NetworkOptions/test/runtests.jl:72
Expression: ssh_known_hosts_file() == bundled
Evaluated: "/private/var/tmp/agent-tempdirs/default-honeycrisp-HL2F7YQ3XH.0/tmp/jl_ORKJOnAJiJ/known_hosts" == "/private/var/tmp/agent-tempdirs/default-honeycrisp-HL2F7YQ3XH.0/tmp/jl_zSOqaz"

Error in testset NetworkOptions:
Test Failed at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-honeycrisp-HL2F7YQ3XH.0/build/default-honeycrisp-HL2F7YQ3XH-0/julialang/julia-master/julia-1e7e80d143/share/julia/stdlib/v1.11/NetworkOptions/test/runtests.jl:166
Expression: ssh_known_hosts_file() == bundled
Evaluated: "/private/var/tmp/agent-tempdirs/default-honeycrisp-HL2F7YQ3XH.0/home/.ssh/known_hosts" == "/private/var/tmp/agent-tempdirs/default-honeycrisp-HL2F7YQ3XH.0/tmp/jl_zSOqaz"

@DilumAluthge
Copy link
Member

@staticfloat Has anything changed on the Mac machines that might explain these test failures?

@DilumAluthge
Copy link
Member

@staticfloat Could this be some kind of multiprocessing-unsafeness? E.g. maybe the NetworkOptions tests are not safe to run at the same time as other tests, and we need to add NetworkOptions to the "move to node 1" list?

@staticfloat
Copy link
Sponsor Member

I'm not aware of anything changing that would cause these failures.

@staticfloat
Copy link
Sponsor Member

It looks like Linux is failing as well, so perhaps this is just a bad commit?

@DilumAluthgeBot DilumAluthgeBot force-pushed the BumpStdlibs/Downloads-246504e-master branch 2 times, most recently from 3f32009 to 533accf Compare August 26, 2023 02:21
@DilumAluthge
Copy link
Member

Yeah, it's failing on all operating systems.

@DilumAluthgeBot DilumAluthgeBot force-pushed the BumpStdlibs/Downloads-246504e-master branch from 533accf to 512e145 Compare August 26, 2023 04:49
@DilumAluthgeBot DilumAluthgeBot force-pushed the BumpStdlibs/Downloads-246504e-master branch from 512e145 to ef31438 Compare August 28, 2023 06:55
@vchuravy
Copy link
Member

vchuravy commented Sep 7, 2023

JuliaLang/Downloads.jl#226 added a precompilation workload.

In NetworkOptions we have:
https://github.com/JuliaLang/NetworkOptions.jl/blob/976e51a48abb4e09356f1979c3cde8fbc0852e2e/src/ssh_options.jl#L147-L159

[46](https://mit-julialab.slack.com/archives/D053XD19UDS/p1694043975620029)
  | | |_| | | | (_| |  |  Version 1.9.1 (2023-06-07)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> using NetworkOptions

julia> NetworkOptions.BUNDLED_KNOWN_HOSTS_FILE
Base.RefValue{String}(#undef)

after:

 _/ |\__'_|_|_|\__'_|  |  vc/libuv_lock/0761a665ae* (fork: 19 commits, 0 days)
|__/                   |

julia> using NetworkOptions

julia> NetworkOptions.BUNDLED_KNOWN_HOSTS_FILE
Base.RefValue{String}("/tmp/jl_CoSSi4")

So the precompilation workload calls bundled_known_hosts() which then means we cache the value of the Ref during serialization instead of letting it be undefined.

Diagnosed for #50880 since we will need to bump Downloads for a concurrency bug.

cc: @gbaraldi @KristofferC

@DilumAluthge
Copy link
Member

Closing in favor of #51246

@DilumAluthge DilumAluthge deleted the BumpStdlibs/Downloads-246504e-master branch September 8, 2023 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stdlib Julia's standard library
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants