Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make strip optional for castToInteger and castToDecimal #797

Merged
merged 3 commits into from
Dec 6, 2022

Conversation

revans2
Copy link
Collaborator

@revans2 revans2 commented Dec 5, 2022

Hive parsing does not strip out leading or trailing white space (for integer and decimal types, float it does because java does it for them).

This makes that stripping optional so we can reuse the existing kernels with hive parsing.

@revans2 revans2 self-assigned this Dec 5, 2022
@revans2
Copy link
Collaborator Author

revans2 commented Dec 5, 2022

build

jlowe
jlowe previously approved these changes Dec 5, 2022
@revans2
Copy link
Collaborator Author

revans2 commented Dec 5, 2022

CI failed because of an spdlog issue that I think is unrelated. Looking into it...

@revans2
Copy link
Collaborator Author

revans2 commented Dec 5, 2022

Looks like the spdlog issue is related to a change to RMM. rapidsai/rmm#1173 (comment) and because CUDF pulls in the latest RMM and we have not fixed NVIDIA/spark-rapids#6445 yet so we let CUDF pull in the latest RMM, which makes our builds not reproducible, we are failing yet again.

hyperbolic2346
hyperbolic2346 previously approved these changes Dec 5, 2022
mythrocks
mythrocks previously approved these changes Dec 5, 2022
@revans2
Copy link
Collaborator Author

revans2 commented Dec 6, 2022

build

@revans2 revans2 dismissed stale reviews from mythrocks, hyperbolic2346, and jlowe via df41cb9 December 6, 2022 16:26
@revans2
Copy link
Collaborator Author

revans2 commented Dec 6, 2022

build

@revans2
Copy link
Collaborator Author

revans2 commented Dec 6, 2022

@jlowe @hyperbolic2346 @mythrocks could you all take another look. I forgot to update the C++ tests, which should be fixed now.

@revans2 revans2 merged commit e90d856 into NVIDIA:branch-23.02 Dec 6, 2022
@revans2 revans2 deleted the hive_parse_help branch December 6, 2022 20:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants