Dlopening MKL on Windows gives "Access is denied" error #38993

giordano · 2020-12-25T00:57:33Z

Just using MKL_jll on Windows should reproduce the error. This is from tests in FFTW.jl:

ERROR: LoadError: LoadError: InitError: could not load library "C:\Users\runneradmin\.julia\artifacts\6de083f4770c1a6b49d179e2aa0f30c4bffde4a4\bin\mkl_core.dll"
Access is denied. 
Stacktrace:
  [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
    @ Base.Libc.Libdl .\libdl.jl:114
  [2] dlopen
    @ .\libdl.jl:114 [inlined]
  [3] __init__()
    @ MKL_jll ~\.julia\packages\MKL_jll\ZCoyO\src\wrappers\x86_64-w64-mingw32.jl:56
  [4] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base .\loading.jl:670
  [5] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base .\loading.jl:756
  [6] _require(pkg::Base.PkgId)
    @ Base .\loading.jl:994
  [7] require(uuidkey::Base.PkgId)
    @ Base .\loading.jl:910
  [8] require(into::Module, mod::Symbol)
    @ Base .\loading.jl:897
  [9] include(mod::Module, _path::String)
    @ Base .\Base.jl:386
 [10] include(x::String)
    @ FFTW D:\a\FFTW.jl\FFTW.jl\src\FFTW.jl:1
 [11] top-level scope
    @ D:\a\FFTW.jl\FFTW.jl\src\FFTW.jl:20
 [12] include
    @ .\Base.jl:386 [inlined]
 [13] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::String)
    @ Base .\loading.jl:1209
 [14] top-level scope
    @ none:1
 [15] eval
    @ .\boot.jl:369 [inlined]
 [16] eval(x::Expr)
    @ Base.MainInclude .\client.jl:453
 [17] top-level scope
    @ none:1
during initialization of module MKL_jll
in expression starting at D:\a\FFTW.jl\FFTW.jl\deps\deps.jl:1
in expression starting at D:\a\FFTW.jl\FFTW.jl\src\FFTW.jl:1
ERROR: LoadError: Failed to precompile FFTW [7a1cc6ca-52ef-59f5-83cd-3a7055c09341] to C:\Users\runneradmin\.julia\compiled\v1.7\FFTW\jl_6DF4.tmp.
Stacktrace:
 [1] error(s::String)
   @ Base .\error.jl:33
 [2] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IOContext{Base.PipeEndpoint}, internal_stdout::IOContext{Base.PipeEndpoint})
   @ Base .\loading.jl:1356
 [3] compilecache(pkg::Base.PkgId, path::String)
   @ Base .\loading.jl:1302
 [4] _require(pkg::Base.PkgId)
   @ Base .\loading.jl:1017
 [5] require(uuidkey::Base.PkgId)
   @ Base .\loading.jl:910
 [6] require(into::Module, mod::Symbol)
   @ Base .\loading.jl:897
 [7] include(fname::String)
   @ Base.MainInclude .\client.jl:451
 [8] top-level scope
   @ none:6
in expression starting at D:\a\FFTW.jl\FFTW.jl\test\runtests.jl:2

This is a regression from v1.5.

The text was updated successfully, but these errors were encountered:

musm · 2020-12-25T19:36:47Z

Might be the same underlying issue as #38411

musm · 2020-12-25T19:37:11Z

Does it happen on 1.5.2?

giordano · 2020-12-25T20:49:24Z

This is a regression from v1.5.

giordano · 2020-12-30T18:36:18Z

I suspect this is not an issue in Julia but in the JLL package (not 100% sure though): JuliaPackaging/BinaryBuilder.jl#982 might fix it in BinaryBuilder.jl, and rebuilding the JLL after that PR is merged should fix the issue for MKL

maleadt · 2021-01-06T15:12:11Z

Also running into this with CUDA.jl on Windows 10 using Julia 1.6:

julia> using CUDA
[ Info: Precompiling CUDA [052768ef-5323-5732-b1bb-66c8b64840ba]

  Downloaded artifact: CUDA112
┌ Error: Error during initialization of CUDA.jl
│   exception =
│    could not load library "C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll"
│    Access is denied.
│    Stacktrace:
│      [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
│        @ Base.Libc.Libdl .\libdl.jl:114
│      [2] dlopen
│        @ .\libdl.jl:114 [inlined]
│      [3] use_artifact_cuda()
│        @ CUDA ~\.julia\dev\CUDA\deps\bindeps.jl:193

shell> ls -la "C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll"
-rwxr-xr-x 1 Tim 197121 107368448 Jan  6 16:05 'C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll'

CUDA.jl doesn't use a JLL for its artifacts, and is using LazyArtifacts already, so that PR doesn't seem like it would help.

~~EDIT: this happens on 1.5 too!? Did anything change with how BinaryBuilder postprocesses libraries, maybe?~~

maleadt · 2021-01-06T17:31:11Z

On a suggestion by @KristofferC, reinstalling on 1.5 fixes the issue there. So this is still 1.6 only; adding it back to the milestone.

               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.5.2 (2020-09-23)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> using Pkg

julia> using Pkg.Artifacts

julia> artifact"MKL"
"C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817"

julia> using Libdl

julia> Libdl.dlopen("C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817\\bin\\mkl_core.1.dll")
Ptr{Nothing} @0x00007ff9bf9a0000

julia> stat("C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817\\bin\\mkl_core.1.dll")
StatStruct(mode=0o100666, size=128026480)

               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.6.0-DEV.1815 (2021-01-05)
 _/ |\__'_|_|_|\__'_|  |  release-1.6/2ed26a04de (fork: 93 commits, 28 days)
|__/                   |

julia> using LazyArtifacts

julia> artifact"MKL"
  Downloaded artifact: MKL
"C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817"

julia> using Libdl

julia> Libdl.dlopen("C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817\\bin\\mkl_core.1.dll")
ERROR: could not load library "C:\Users\Tim\.julia\artifacts\16b430c39e14696365ac62dbd091da0e54556817\bin\mkl_core.1.dll"
Access is denied.
Stacktrace:
 [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
   @ Base.Libc.Libdl .\libdl.jl:114
 [2] dlopen
   @ .\libdl.jl:114 [inlined]
 [3] top-level scope
   @ REPL[4]:1

julia> stat("C:\\Users\\Tim\\.julia\\artifacts\\16b430c39e14696365ac62dbd091da0e54556817\\bin\\mkl_core.1.dll")
StatStruct(mode=0o100666, size=128026480)

Although the stat looks identical, the advanced permissions aren't:

1.5:

1.6:

giordano · 2021-01-06T17:56:26Z

reinstalling on 1.5 fixes the issue there

So the difference is maybe how the artifact is unpacked?

maleadt · 2021-01-07T14:43:50Z

Unsurprisingly bisected to a Pkg.jl/Tar.jl bump, #38678, which includes this change: JuliaIO/Tar.jl@1b63f2a. Reverting this hunk allows me to dlopen these artifacts again. I couldn't find specific ACL requirements in the Windows API docs, but it looks like LoadLibraryEx needs the execute bit. Quite a roundabout way to get to this conclusion, but I'm pretty unfamiliar with Windows.

Anyway, this looks like something BinaryBuilder should fix (both MKL_jll and CUDA_jll's libraries are chmodded 644 instead of 755), but of course breaks loading artifacts that used to load fine. Tentatively adding the "regression" label because of that.

cc @StefanKarpinski @staticfloat

staticfloat · 2021-01-07T17:14:48Z

Hmmm, yeah, I think the proper fix here is to just have BB generate the artifacts with the proper permissions; this seems like things are finally working as intended. It is unfortunate that MKL and CUDA both have incorrectly-chmod'ded files, perhaps we need to add an audit pass to BB to auto-chmod stuff in bin and lib?

giordano · 2021-01-07T17:23:10Z

We don't run autofix on MKL for Windows at the moment: https://github.com/JuliaPackaging/Yggdrasil/blob/e17db19b1fba946c256e875639c23db2446f282f/M/MKL/build_tarballs.jl#L55-L57. I'm looking forward to finding what bugs we discover with that.

maleadt · 2021-01-12T17:48:31Z

Fixing the CUDA artifacts, JuliaPackaging/Yggdrasil@aabb21c, has resolved this. I think we can close this then (but MKL_jll still needs fixing).

islent · 2021-01-23T09:06:07Z

Also running into this with CUDA.jl on Windows 10 using Julia 1.6:

julia> using CUDA
[ Info: Precompiling CUDA [052768ef-5323-5732-b1bb-66c8b64840ba]

  Downloaded artifact: CUDA112
┌ Error: Error during initialization of CUDA.jl
│   exception =
│    could not load library "C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll"
│    Access is denied.
│    Stacktrace:
│      [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
│        @ Base.Libc.Libdl .\libdl.jl:114
│      [2] dlopen
│        @ .\libdl.jl:114 [inlined]
│      [3] use_artifact_cuda()
│        @ CUDA ~\.julia\dev\CUDA\deps\bindeps.jl:193

shell> ls -la "C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll"
-rwxr-xr-x 1 Tim 197121 107368448 Jan  6 16:05 'C:\Users\Tim\.julia\artifacts\1aecead5cc57a9388d3b46929549edb0ef99912f\bin\cublas64_11.dll'

CUDA.jl doesn't use a JLL for its artifacts, and is using LazyArtifacts already, so that PR doesn't seem like it would help.

~~EDIT: this happens on 1.5 too!? Did anything change with how BinaryBuilder postprocesses libraries, maybe?~~

Got same error when using CUDA in Julia 1.7 (and 1.6.0-DEV). However, CUDA works well in Julia 1.5.2.

maleadt · 2021-01-23T17:22:21Z

There hasn't been a release of CUDA.jl with the new artifacts yet. Use the master branch (or include JuliaGPU/CUDA.jl@749d7e0) if you need to use Julia 1.6.

PetrKryslUCSD · 2021-02-02T17:52:16Z

A file in an artifact that should be executable isn't: sglyon/PlotlyBase.jl#40, with Julia 1.6.

giordano · 2021-02-02T17:54:27Z

As I explained on discourse, the issue is that the creator of the tarball put a file with the wrong file permissions. It isn't a Julia issue.

PetrKryslUCSD · 2021-02-02T17:58:42Z

I see, somehow I gathered that the tarball was unpacked incorrectly. So, you're saying that the file was put into the ball without the proper permissions? Got it.

BioTurboNick · 2022-01-08T07:41:58Z

@giordano - I think this diagnosis is incorrect. I can reproduce the problem shown by @maleadt without any artifacts at all. It appears to be introduced by create_artifact()'s use of chmod().

We encountered this here: JuliaGraphics/Gtk.jl#605

The issue can be reproduced simply:

dir = "mydir\\"

mkdir(dir)
# Check Properties > Security; note SYSTEM, <current user>, Administrators, all have Full Control

chmod(dir, filemode(dir))
# Check Properties > Security; note Everyone added, both Everyone and <current user> have only Read, Write, Special permissions

BioTurboNick · 2022-01-08T16:03:37Z

Hmm...

Base.Filesystem.filemode_string(stat(dir))

produces "drw-rw-rw-" even though the current user and the user's group both should have execute permissions and Everyone should have no permissions set.

There seems to be some issues mapping Windows ACL to Linux mode values.

filemode(dir) seems to always indicate the mode is 666, even if you just used chmod to set it to 777.

And then here's what chmod does; how it treats the current user/owner and Everyone seems odd:

chmod(dir, 0x770) denies the current user ability to create or delete files, but otherwise has read/write/execute permissions; Everyone is not present.

chmod(dir, 0x771) denies the current user ability to create or delete files, but otherwise has read/write/execute permissions; adds Everyone with only traverse / execute permissions.

chmod(dir, 0x772) denies the current user ability to create or delete files, but otherwise has read/write/execute permissions; adds Everyone with ability to create or delete files, but not traverse / execute.

chmod(dir, 0x773) denies the current user ability to create or delete files or to traverse / execute, but otherwise has read/write permissions; adds Everyone with ability to create or delete files and traverse / execute.

chmod(dir, 0x774) denies the current user ability to create or delete files, but otherwise has read/write/execute permissions; adds Everyone with ability to read.

chmod(dir, 0x775) denies the current user ability to create or delete files or to traverse / execute, but otherwise has read/write permissions; adds Everyone with ability to read and traverse / execute.

chmod(dir, 0x776) denies the current user ability to create or delete files, but otherwise has read/write/execute permissions; adds Everyone with ability to read and write.

chmod(dir, 0x777) denies the current user ability to create or delete files or to traverse / execute, but otherwise has read/write permissions; adds Everyone with ability to read, write, and execute.

BioTurboNick · 2022-01-08T16:11:02Z

I guess this is an unsolved problem in libuv? libuv/libuv#2838

giordano changed the title ~~Dlopening MKL on Windows gives "denied access" error~~ Dlopening MKL on Windows gives "Access is denied" error Dec 25, 2020

giordano mentioned this issue Dec 25, 2020

MassInstallAction: Install the CI workflow on this repository JuliaMath/FFTW.jl#172

Merged

giordano mentioned this issue Jan 2, 2021

Lazy artifacts pre and post Julia 1.6 #39067

Closed

ViralBShah added linear algebra Linear algebra packages Package management and loading labels Jan 2, 2021

maleadt modified the milestone: 1.6 blockers Jan 6, 2021

maleadt added this to the 1.6 blockers milestone Jan 6, 2021

maleadt added regression Regression in behavior compared to a previous version system:windows Affects only Windows and removed linear algebra Linear algebra labels Jan 7, 2021

This was referenced Jan 8, 2021

[CUDA] Fix permissions of DLLs. JuliaPackaging/Yggdrasil#2367

Merged

Bump artifacts for Windows/Julia 1.6 compatibility. JuliaGPU/CUDA.jl#639

Merged

maleadt closed this as completed Jan 12, 2021

maleadt mentioned this issue Jan 23, 2021

could not load cublas64_11.dll JuliaGPU/CUDA.jl#670

Closed

giordano mentioned this issue Feb 2, 2021

Warning: Kaledio is not available on this system. Julia will be unable to produce any plots. (aarch64) sglyon/PlotlyBase.jl#40

Closed

jamesgardner1421 mentioned this issue Aug 17, 2021

InitError on Windows loading libcleri.dll libAtoms/ExtXYZ.jl#6

Closed

DrChainsaw mentioned this issue Oct 26, 2021

towards windows support, switch to onnxruntime v1.9.0 jw3126/ONNXRunTime.jl#11

Merged

gnadt mentioned this issue Jul 18, 2023

Code problem MIT-AI-Accelerator/MagNav.jl#203

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Dlopening MKL on Windows gives "Access is denied" error #38993

Dlopening MKL on Windows gives "Access is denied" error #38993

giordano commented Dec 25, 2020

musm commented Dec 25, 2020

musm commented Dec 25, 2020

giordano commented Dec 25, 2020

giordano commented Dec 30, 2020

maleadt commented Jan 6, 2021 •

edited

Loading

maleadt commented Jan 6, 2021

giordano commented Jan 6, 2021

maleadt commented Jan 7, 2021 •

edited

Loading

staticfloat commented Jan 7, 2021

giordano commented Jan 7, 2021

maleadt commented Jan 12, 2021

islent commented Jan 23, 2021

maleadt commented Jan 23, 2021

PetrKryslUCSD commented Feb 2, 2021

giordano commented Feb 2, 2021

PetrKryslUCSD commented Feb 2, 2021 •

edited

Loading

BioTurboNick commented Jan 8, 2022 •

edited

Loading

BioTurboNick commented Jan 8, 2022

BioTurboNick commented Jan 8, 2022

Dlopening MKL on Windows gives "Access is denied" error #38993

Dlopening MKL on Windows gives "Access is denied" error #38993

Comments

giordano commented Dec 25, 2020

musm commented Dec 25, 2020

musm commented Dec 25, 2020

giordano commented Dec 25, 2020

giordano commented Dec 30, 2020

maleadt commented Jan 6, 2021 • edited Loading

maleadt commented Jan 6, 2021

giordano commented Jan 6, 2021

maleadt commented Jan 7, 2021 • edited Loading

staticfloat commented Jan 7, 2021

giordano commented Jan 7, 2021

maleadt commented Jan 12, 2021

islent commented Jan 23, 2021

maleadt commented Jan 23, 2021

PetrKryslUCSD commented Feb 2, 2021

giordano commented Feb 2, 2021

PetrKryslUCSD commented Feb 2, 2021 • edited Loading

BioTurboNick commented Jan 8, 2022 • edited Loading

BioTurboNick commented Jan 8, 2022

BioTurboNick commented Jan 8, 2022

maleadt commented Jan 6, 2021 •

edited

Loading

maleadt commented Jan 7, 2021 •

edited

Loading

PetrKryslUCSD commented Feb 2, 2021 •

edited

Loading

BioTurboNick commented Jan 8, 2022 •

edited

Loading