Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segfault when filtering Arrow-backed DataFrame #257

Open
ericphanson opened this issue Oct 28, 2021 · 2 comments
Open

Segfault when filtering Arrow-backed DataFrame #257

ericphanson opened this issue Oct 28, 2021 · 2 comments
Labels
bug Something isn't working

Comments

@ericphanson
Copy link
Member

signal (11): Segmentation fault
in expression starting at none:1
unknown function (ip: 0x7f82a3ce5527)
jl_symbol_n at /buildworker/worker/package_linux64/build/src/symbol.c:113
_symbol at /home/ubuntu/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:208 [inlined]
fromarrow at /home/ubuntu/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:209 [inlined]
getindex at /home/ubuntu/.julia/packages/Arrow/PQ5Mm/src/arraytypes/list.jl:56 [inlined]
macro expansion at ./multidimensional.jl:860 [inlined]
macro expansion at ./cartesian.jl:64 [inlined]
_unsafe_getindex! at ./multidimensional.jl:855 [inlined]
_unsafe_getindex at ./multidimensional.jl:846
_getindex at ./multidimensional.jl:832 [inlined]
getindex at ./abstractarray.jl:1170
unknown function (ip: 0x7f821e6d691c)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2237 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2419
_threaded_getindex at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/dataframe/dataframe.jl:531
getindex at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/dataframe/dataframe.jl:574 [inlined]
#filter#78 at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/abstractdataframe/abstractdataframe.jl:1017 [inlined]
filter at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/abstractdataframe/abstractdataframe.jl:1016 [inlined]

which points to https://github.com/JuliaData/Arrow.jl/blob/56f8f9342389c1b9664157ca4a2d1f5501d8341d/src/ArrowTypes/src/ArrowTypes.jl#L208

I don't have a MWE currently.

@jariji
Copy link

jariji commented Aug 26, 2022

Another one. I think I'm calling copy(::DataFrame).

signal (11): Segmentation fault
in expression starting at /home/...
__memmove_sse2_unaligned_erms at /nix/store/s9qbqh7gzacs7h68b2jfmn9l6q4jwfjz-glibc-2.33-59/lib/libc.so.6 (unknown line)
jl_pchar_to_string at /buildworker/worker/package_linux64/build/src/array.c:507
unsafe_string at ./strings/string.jl:67 [inlined]
fromarrow at /home/user/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:201 [inlined]
getindex at /home/user/.julia/packages/Arrow/ZlMFU/src/arraytypes/list.jl:56 [inlined]
copyto_unaliased! at ./abstractarray.jl:1018
copyto! at ./abstractarray.jl:998
copymutable at ./abstractarray.jl:1129
copy at ./abstractarray.jl:1073 [inlined]
_preprocess_column at /home/user/.julia/packages/DataFrames/zqFGs/src/dataframe/dataframe.jl:229
unknown function (ip: 0x7fbb3c15a98e)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2247 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2429
#155 at ./threadingconstructs.jl:178
unknown function (ip: 0x7fb88a1a3c1f)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2247 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2429
jl_apply at /buildworker/worker/package_linux64/build/src/julia.h:1788 [inlined]
start_task at /buildworker/worker/package_linux64/build/src/task.c:877
Allocations: 917429815 (Pool: 917324438; Big: 105377); GC: 1888
zsh: segmentation fault (core dumped)  juliab

@ericphanson
Copy link
Member Author

I wonder if JuliaLang/julia#47865 is related; the _Symbol there differs from the problematic line here by a root argument 🤔

@ericphanson ericphanson added the bug Something isn't working label Apr 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants