Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does not work on Julia 1.6 #1

Open
ericphanson opened this issue Jun 30, 2024 · 1 comment
Open

Does not work on Julia 1.6 #1

ericphanson opened this issue Jun 30, 2024 · 1 comment

Comments

@ericphanson
Copy link
Owner

I couldn't get it working on linux on 1.6 due to libstdcxx stuff. On MacOS it seemed to work.

With pyarrow below v9.0, I got

ERROR: LoadError: InitError: Python: ImportError: /opt/hostedtoolcache/julia/1.6.7/x64/bin/../lib/julia/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /tmp/jl_snB82v/.CondaPkg/env/lib/python3.10/site-packages/pyarrow/../../../libarrow.so.800)
Python stacktrace:
 [1] <module>
   @ /tmp/jl_snB82v/.CondaPkg/env/lib/python3.10/site-packages/pyarrow/__init__.py:65
Stacktrace:
  [1] pythrow()
    @ PythonCall.Core ~/.julia/packages/PythonCall/S5MOg/src/Core/err.jl:92
  [2] errcheck
    @ ~/.julia/packages/PythonCall/S5MOg/src/Core/err.jl:10 [inlined]
  [3] pyimport(m::String)
    @ PythonCall.Core ~/.julia/packages/PythonCall/S5MOg/src/Core/builtins.jl:1444
  [4] __init__()
    @ PyArrow ~/work/PyArrow.jl/PyArrow.jl/src/PyArrow.jl:32
  [5] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base ./loading.jl:696
  [6] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base ./loading.jl:782
  [7] _require(pkg::Base.PkgId)
    @ Base ./loading.jl:1020
  [8] require(uuidkey::Base.PkgId)
    @ Base ./loading.jl:936
  [9] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:923
 [10] include(fname::String)
    @ Base.MainInclude ./client.jl:444
 [11] top-level scope

https://github.com/ericphanson/PyArrow.jl/actions/runs/9734526547/job/26862658855

With pyarrow >= v9.0, I got

CondaPkg Resolving changes
             + libstdcxx-ng
             + numpy
             + pyarrow
             + python
    CondaPkg Creating environment
             │ /home/runner/.julia/artifacts/7973f2c7725e2d0eef7a95159454c4145f0945a2/bin/micromamba
             │ -r /home/runner/.julia/scratchspaces/0b3b1443-0f03-428d-bdfb-f27f9c1191ea/root
             │ create
             │ -y
             │ -p /tmp/jl_tg5rLD/.CondaPkg/env
             │ --override-channels
             │ --no-channel-priority
             │ libstdcxx-ng[version='>=3.4,<12.0']
             │ numpy[version='>=1,<2']
             │ pyarrow[version='>=9.0,<17']
             │ python[version='>=3.8,<4',channel='conda-forge',build='*cpython*']
             └ -c conda-forge
conda-forge/linux-64                                        Using cache
conda-forge/noarch                                          Using cache
error    libmamba Could not solve for environment specs
    The following packages are incompatible
    ├─ libstdcxx-ng >=3.4,<12.0  is requested and can be installed;
    └─ pyarrow >=9.0,<17  is not installable because there are no viable options
       ├─ pyarrow [10.0.1|11.0.0|...|9.0.0] would require
       │  ├─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  └─ numpy [>=1.22.4,<2.0a0 |>=1.23.5,<2.0a0 |>=1.26.4,<2.0a0 ], which requires
       │     └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       ├─ pyarrow [10.0.1|11.0.0|12.0.0|12.0.1|9.0.0] would require
       │  ├─ abseil-cpp >=20210324.2,<20210324.3.0a0 , which requires
       │  │  └─ libstdcxx-ng >=9.3.0  with the potential options
       │  │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │     ├─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │     ├─ libstdcxx-ng 9.3.0, which can be installed;
       │  │     └─ libstdcxx-ng [9.4.0|9.5.0], which can be installed;
       │  ├─ arrow-cpp [9.0.0 py310h025e8b3_0_cuda|9.0.0 py310h0c3043d_31_cuda|...|9.0.0 py39hf0dfd39_29_cuda] but there are no viable options
       │  │  ├─ arrow-cpp 9.0.0 would require
       │  │  │  ├─ glog >=0.6.0,<0.7.0a0 , which requires
       │  │  │  │  └─ libstdcxx-ng >=10.3.0  with the potential options
       │  │  │  │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  │  │     └─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  │  ├─ libprotobuf [>=3.21.10,<3.22.0a0 |>=3.21.11,<3.22.0a0 ], which requires
       │  │  │  │  └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │  ├─ lz4-c >=1.9.3,<1.10.0a0  with the potential options
       │  │  │  │  ├─ lz4-c 1.9.3 would require
       │  │  │  │  │  └─ libstdcxx-ng >=9.3.0  with the potential options
       │  │  │  │  │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  │  │  │     ├─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  │  │  │     ├─ libstdcxx-ng 9.3.0, which can be installed;
       │  │  │  │  │     └─ libstdcxx-ng [9.4.0|9.5.0], which can be installed;
       │  │  │  │  └─ lz4-c 1.9.4 would require
       │  │  │  │     └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │  ├─ orc [>=1.8.1,<1.8.2.0a0 |>=1.8.2,<1.8.3.0a0 ], which requires
       │  │  │  │  └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │  ├─ re2 [>=2022.6.1,<2022.6.2.0a0 |>=2023.2.1,<2023.2.2.0a0 |>=2023.2.2,<2023.2.3.0a0 ], which requires
       │  │  │  │  └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │  ├─ snappy [>=1.1.10,<1.2.0a0 |>=1.1.9,<1.2.0a0 ] with the potential options
       │  │  │  │  ├─ snappy 1.1.9 would require
       │  │  │  │  │  └─ libstdcxx-ng >=10.3.0  with the potential options
       │  │  │  │  │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  │  │  │     └─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  │  │  └─ snappy [1.1.10|1.1.9] would require
       │  │  │  │     └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │  └─ zstd >=1.5.2,<1.6.0a0  with the potential options
       │  │  │     ├─ zstd [1.5.2|1.5.5|1.5.6] would require
       │  │  │     │  └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  │  │     ├─ zstd 1.5.2 would require
       │  │  │     │  └─ libstdcxx-ng >=10.3.0  with the potential options
       │  │  │     │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  │     │     └─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  │     └─ zstd 1.5.2 would require
       │  │  │        └─ libstdcxx-ng >=9.4.0  with the potential options
       │  │  │           ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  │           ├─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  │           └─ libstdcxx-ng [9.4.0|9.5.0], which can be installed;
       │  │  ├─ arrow-cpp 9.0.0 would require
       │  │  │  ├─ re2 >=2022.6.1,<2022.6.2.0a0 , which cannot be installed (as previously explained);
       │  │  │  ├─ snappy >=1.1.9,<1.2.0a0  with the potential options
       │  │  │  │  ├─ snappy 1.1.9, which can be installed (as previously explained);
       │  │  │  │  └─ snappy [1.1.10|1.1.9], which cannot be installed (as previously explained);
       │  │  │  └─ zstd >=1.5.2,<1.6.0a0  with the potential options
       │  │  │     ├─ zstd [1.5.2|1.5.5|1.5.6], which cannot be installed (as previously explained);
       │  │  │     ├─ zstd 1.5.2, which can be installed (as previously explained);
       │  │  │     └─ zstd 1.5.2, which can be installed (as previously explained);
       │  │  └─ arrow-cpp 9.0.0 would require
       │  │     ├─ glog >=0.6.0,<0.7.0a0 , which can be installed (as previously explained);
       │  │     ├─ libprotobuf [>=3.21.10,<3.22.0a0 |>=3.21.11,<3.22.0a0 ], which cannot be installed (as previously explained);
       │  │     ├─ orc [>=1.8.1,<1.8.2.0a0 |>=1.8.2,<1.8.3.0a0 ], which cannot be installed (as previously explained);
       │  │     ├─ re2 [>=2022.6.1,<2022.6.2.0a0 |>=2023.2.1,<2023.2.2.0a0 |>=2023.2.2,<2023.2.3.0a0 ], which cannot be installed (as previously explained);
       │  │     └─ snappy [>=1.1.10,<1.2.0a0 |>=1.1.9,<1.2.0a0 ] with the potential options
       │  │        ├─ snappy 1.1.9, which can be installed (as previously explained);
       │  │        └─ snappy [1.1.10|1.1.9], which cannot be installed (as previously explained);
       │  ├─ libabseil [20211102.0 cxx17*|20220623.0 cxx17*], which requires
       │  │  └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       │  ├─ libarrow [10.0.1 *_33_cuda|10.0.1 *_34_cuda|...|12.0.1 hce8[178](https://github.com/ericphanson/PyArrow.jl/actions/runs/9734555069/job/26862727743#step:6:181)f_0_cuda] but there are no viable options
       │  │  ├─ libarrow [10.0.1|11.0.0] would require
       │  │  │  ├─ glog >=0.6.0,<0.7.0a0 , which can be installed (as previously explained);
       │  │  │  ├─ libprotobuf >=3.21.10,<3.22.0a0 , which cannot be installed (as previously explained);
       │  │  │  ├─ lz4-c >=1.9.3,<1.10.0a0  with the potential options
       │  │  │  │  ├─ lz4-c 1.9.3, which can be installed (as previously explained);
       │  │  │  │  └─ lz4-c 1.9.4, which cannot be installed (as previously explained);
       │  │  │  ├─ orc [>=1.8.1,<1.8.2.0a0 |>=1.8.2,<1.8.3.0a0 ], which cannot be installed (as previously explained);
       │  │  │  ├─ re2 [>=2023.2.1,<2023.2.2.0a0 |>=2023.2.2,<2023.2.3.0a0 ], which cannot be installed (as previously explained);
       │  │  │  └─ snappy [>=1.1.10,<1.2.0a0 |>=1.1.9,<1.2.0a0 ] with the potential options
       │  │  │     ├─ snappy 1.1.9, which can be installed (as previously explained);
       │  │  │     └─ snappy [1.1.10|1.1.9], which cannot be installed (as previously explained);
       │  │  └─ libarrow [10.0.1|11.0.0|12.0.0|12.0.1] would require
       │  │     ├─ glog >=0.6.0,<0.7.0a0 , which can be installed (as previously explained);
       │  │     └─ snappy >=1.1.10,<1.2.0a0 , which cannot be installed (as previously explained);
       │  ├─ libstdcxx-ng >=7.5.0  with the potential options
       │  │  ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │  │  ├─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │  │  ├─ libstdcxx-ng [7.5.0|8.4.0|8.5.0|9.2.0], which can be installed;
       │  │  ├─ libstdcxx-ng 9.3.0, which can be installed;
       │  │  └─ libstdcxx-ng [9.4.0|9.5.0], which can be installed;
       │  └─ numpy [>=1.21.6,<2.0a0 |>=1.23.4,<2.0a0 |>=1.23.5,<2.0a0 ] with the potential options
       │     ├─ numpy [1.22.4|1.23.0|...|1.26.4], which cannot be installed (as previously explained);
       │     ├─ numpy [1.21.6|1.22.3] would require
       │     │  └─ libstdcxx-ng >=10.3.0  with the potential options
       │     │     ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │     │     └─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │     └─ numpy [1.22.0|1.22.1|1.22.2] would require
       │        └─ libstdcxx-ng >=9.4.0  with the potential options
       │           ├─ libstdcxx-ng [12.1.0|12.2.0|...|14.1.0] conflicts with any installable versions previously reported;
       │           ├─ libstdcxx-ng [10.3.0|10.4.0|...|11.4.0], which can be installed;
       │           └─ libstdcxx-ng [9.4.0|9.5.0], which can be installed;
       ├─ pyarrow [16.0.0|16.1.0] would require
       │  └─ pyarrow-core [16.0.0 *_0_*|16.1.0 *_0_*|...|16.1.0 *_4_*] but there are no viable options
       │     ├─ pyarrow-core [16.0.0|16.1.0] would require
       │     │  └─ __cuda >=11.8 , which is missing on the system;
       │     └─ pyarrow-core [16.0.0|16.1.0] would require
       │        └─ libstdcxx-ng >=12 , which conflicts with any installable versions previously reported;
       ├─ pyarrow 9.0.0 would require
       │  └─ __cuda >=11.2 , which is missing on the system;
       └─ pyarrow 9.0.0 would require
          └─ __cuda >=10.2 , which is missing on the system.
critical libmamba Could not solve for environment specs

https://github.com/ericphanson/PyArrow.jl/actions/runs/9734555069/job/26862727743

@ericphanson
Copy link
Owner Author

I bumped the Julia compat to 1.8+ since there we have JuliaLang/julia#45582

@ericphanson ericphanson changed the title Does not work on 1.6 Does not work on Julia 1.6 Jun 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant