Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add in support for setting delim when parsing JSON through java (#16867) #16880

Merged
merged 1 commit into from
Sep 24, 2024

Conversation

revans2
Copy link
Contributor

@revans2 revans2 commented Sep 23, 2024

This is a back-port of #16867 to 24.10.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

…dsai#16867)

This just adds in JNI APIs to allow for changing the delimiter when parsing JSON.

Authors:
  - Robert (Bobby) Evans (https://github.com/revans2)

Approvers:
  - Alessandro Bellina (https://github.com/abellina)
  - Nghia Truong (https://github.com/ttnghia)

URL: rapidsai#16867
@revans2 revans2 requested a review from a team as a code owner September 23, 2024 21:24
@github-actions github-actions bot added the Java Affects Java cuDF API. label Sep 23, 2024
@revans2 revans2 added 3 - Ready for Review Ready for review by team Spark Functionality that helps Spark RAPIDS non-breaking Non-breaking change cuDF (Java) improvement Improvement / enhancement to an existing function labels Sep 23, 2024
@revans2
Copy link
Contributor Author

revans2 commented Sep 23, 2024

The main reason to backport this is that it could unblock a serious performance improvement in spark json parsing.

@GregoryKimball and @karthikeyann is it okay for this to go in?

@ttnghia and @abellina you approved the previous version, there were no code changes here.

@GregoryKimball
Copy link
Contributor

I support this change. Thanks @revans2 for opening this!

@revans2
Copy link
Contributor Author

revans2 commented Sep 24, 2024

/merge

@rapids-bot rapids-bot bot merged commit 6badd6b into rapidsai:branch-24.10 Sep 24, 2024
83 checks passed
@revans2 revans2 deleted the java_delim-24.10 branch September 24, 2024 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team improvement Improvement / enhancement to an existing function Java Affects Java cuDF API. non-breaking Non-breaking change Spark Functionality that helps Spark RAPIDS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants