Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(python,rust): Make read_json accept empty list input and return empty df #18594

Closed
wants to merge 54 commits into from
Closed

fix(python,rust): Make read_json accept empty list input and return empty df #18594

wants to merge 54 commits into from

Conversation

deanm0000
Copy link
Collaborator

fixes #7355

@github-actions github-actions bot added fix Bug fix python Related to Python Polars rust Related to Rust Polars labels Sep 6, 2024
@deanm0000 deanm0000 marked this pull request as draft September 6, 2024 21:34
@deanm0000
Copy link
Collaborator Author

I put this in draft b/c I've got a bit in the testing b/c I wanted to see more info from the failed test but those changes shouldn't persist.

alonme and others added 10 commits September 7, 2024 09:34
@alonme
docs: Fix multiprocessing docs regarding fork method check (pola-rs#1…
17cf78f 
…8563)
@ion-elgreco
test(python): Fix delta test merge (pola-rs#18601)
9a256a3
@adamreeve @ritchie46
feat: Add IEJoin algorithm for non-equi joins and support Full non-ec…
80769d2 
…qui joins (pola-rs#18365)

Co-authored-by: ritchie <[email protected]>
@nameexhaustion
perf: Add upfront partitioning in ColumnChunkMetadata (pola-rs#18584)
de344d6
@MarcoGorelli
fix: Allow for date/datetime subclasses (e.g. pd.Timestamp, FreezeGun…
5d7f41e 
…) in pl.lit (pola-rs#18497)
@eitsupi
fix(rust): Functions for streaming require streaming feature (pola-…
a0d28fd 
…rs#18602)
@megaserg
test(python): Use streaming argument in `test_parquet_slice_pushdow…
aa0b1ed 
…n_non_zero_offset` (pola-rs#18529)
@alexander-beedie
feat(python): Support shortcut eval of common boolean filters in SQL …
ac4b114 
…interface "WHERE" clause (pola-rs#18571)
@ritchie46
fix: Fix group first value after group-by slice (pola-rs#18603)
6037ca5
@MarcoGorelli
ci: Fix Python docs build (pola-rs#18605)
98788b2
ritchie46 and others added 29 commits September 9, 2024 10:28
@ritchie46
refactor(rust): One simplify expression module and keep utility local (…
0fe5914 
…pola-rs#18621)
@nameexhaustion
perf: Don't traverse file list twice for extension validation (pola-r…
1a1796a 
…s#18620)
@nameexhaustion
refactor(rust): Remove extra schema traits (pola-rs#18616)
253057a
@henryharbeck
fix(python): Raise if single argument form in replace/`replace_stri…
433d6c0 
…ct` is not a mapping (pola-rs#18492)

Co-authored-by: Henry Harbeck <[email protected]>
@orlp
refactor(rust): Fix unimplemented panics to give todo!s for AUTO_NEW_…
4d176e0 
…STREAMING (pola-rs#18628)
@orlp
fix: Properly slice validity mask on pl.Object series (pola-rs#18631)
72d861e
@orlp
fix: Use Buffer<T> in ObjectSeries, fixes variety of offset bugs (pol…
76a340b 
…a-rs#18637)
@ritchie46
refactor: Change join_where semantics (pola-rs#18640)
45c8e96
@nameexhaustion
refactor(rust): Rename MetaData -> Metadata (pola-rs#18644)
8ebd739
@philss
fix: Enable "polars-json/timezones" feature from "polars-io" (pola-rs…
38b376c 
…#18635)
@nameexhaustion @Veiasai
fix: Scanning hive partitioned files where hive columns are partially…
5ccb238 
… included in the file (pola-rs#18626)

Co-authored-by: jinliu <[email protected]>
@nameexhaustion
refactor(rust): Scan from BytesIO in new-streaming parquet source (po…
832aa53 
…la-rs#18643)
@ritchie46
chore(rust): Feature gate iejoin (pola-rs#18646)
1ee6a82
@ritchie46
chore: Check predicates in join_where (pola-rs#18648)
5658e65
@nameexhaustion
refactor(rust): Split parquet_source.rs in new-streaming (pola-rs#1…
fe04390 
…8649)
@ritchie46
chore: Don't raise on multiple same names in ie_join (pola-rs#18658)
760ab20
@nameexhaustion
refactor(rust): Rename MemSlice::from_slice -> `MemSlice::from_stat…
655c781 
…ic` (pola-rs#18657)
@orlp
refactor: Fix a bunch of tests for new-streaming (pola-rs#18659)
2e92f0a
@nameexhaustion
refactor(rust): Remove duplicate byte range calc from new parquet sou…
ad9a1d8 
…rce (pola-rs#18655)
@nameexhaustion
refactor(rust): Re-use already decoded metadata for first path (new-p…
5c4e7e9 
…arquet-source) (pola-rs#18656)
@deanm0000
make_read_json_accept_empty_list
16d8c83
@deanm0000
lint
1e23e5e
@deanm0000
fmt
f0dcd24
@deanm0000
clippy
cd04dee
@deanm0000
print_delta_version
03d9eba
@deanm0000
rd2
a92121d
@deanm0000
again
270fa93
@deanm0000
wee
0adb6de
@deanm0000
Merge branch 'empty_json' of https://github.com/deanm0000/polars into…
a90705e 
… empty_json
@deanm0000 deanm0000 closed this Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ritchie46 ritchie46 Awaiting requested review from ritchie46 ritchie46 is a code owner

@c-peters c-peters Awaiting requested review from c-peters c-peters is a code owner

@alexander-beedie alexander-beedie Awaiting requested review from alexander-beedie alexander-beedie is a code owner

@MarcoGorelli MarcoGorelli Awaiting requested review from MarcoGorelli MarcoGorelli is a code owner

@reswqa reswqa Awaiting requested review from reswqa reswqa is a code owner

@orlp orlp Awaiting requested review from orlp orlp is a code owner

@wence- wence- Awaiting requested review from wence- wence- will be requested when the pull request is marked ready for review wence- is a code owner

@coastalwhite coastalwhite Awaiting requested review from coastalwhite coastalwhite will be requested when the pull request is marked ready for review coastalwhite is a code owner

Assignees
No one assigned
Labels
fix Bug fix python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

polars.read_json fails when reading empty list from json response