Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Undefined symbol for pyarrow #1194

Closed
2 tasks done
mjkanji opened this issue Apr 15, 2024 · 3 comments
Closed
2 tasks done

Undefined symbol for pyarrow #1194

mjkanji opened this issue Apr 15, 2024 · 3 comments
Labels
🐞 bug Something isn't working needs-more Needs more information from the reporter

Comments

@mjkanji
Copy link

mjkanji commented Apr 15, 2024

Checks

  • I have checked that this issue has not already been reported.

  • I have confirmed this bug exists on the latest version of pixi, using pixi --version.

Reproducible example

My pixi.toml is shown below.

pixi.toml
[project]
name = "easyknock_analytics"
version = "0.1.0"
description = "Add a short description here"
authors = ["Muhammad Jarir Kanji <[email protected]>"]
channels = ["conda-forge"]
platforms = ["linux-64", "osx-arm64"]

[tasks]
dbt_run = { cmd = "dbt run" }

[dependencies]
python = ">=3.10,<3.11"
pip = "*"
pre-commit = "*"
pytz = "*"
pandas = ">=2.2.2,<2.3"

[pypi-dependencies]
dbt-core = { version = ">=1.7, <1.8" }
dbt-redshift = "*"
sqlfluff = "*"
sqlfluff-templater-dbt = "*"
dbt-coves = "*"

[feature.dev.dependencies]


[environments]
dev = { features = ["dev"], solve-group = "dev" }
prod = { features = [], solve-group = "dev" }

Then, simply do:

pixi run python
> import pyarrow

Issue description

This results in an undefined symbol error for Arrow:

ImportError: .pixi/envs/default/lib/python3.10/site-packages/pyarrow/libarrow_python.so: undefined symbol: _ZNK5arrow8DataType18ComputeFingerprintB5cxx11Ev

Expected behavior

That Pyarrow should be installed properly.

@mjkanji mjkanji added the 🐞 bug Something isn't working label Apr 15, 2024
@mjkanji mjkanji changed the title Undefined symbol for libarrow Undefined symbol for pyarrow Apr 15, 2024
@ruben-arts
Copy link
Contributor

He I can't reproduce it, could you provide a pixi.lock for which this issue exist?

I installed your pixi.toml on my linux-64 machine and I could correctly import pyarrow

@ruben-arts ruben-arts added the needs-more Needs more information from the reporter label Apr 15, 2024
@tadejsv
Copy link

tadejsv commented Apr 18, 2024

I remember having such an issue - the problem was that pyarrow installed by pypi was interfering with pyarrow installed by pixi

@baszalmstra
Copy link
Contributor

Closing this since missing a proper reproducer. Feel free to reopen if you are still having problems!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐞 bug Something isn't working needs-more Needs more information from the reporter
Projects
None yet
Development

No branches or pull requests

4 participants