Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Support strict=False casting in cudf-polars #17244

Open
brandon-b-miller opened this issue Nov 4, 2024 · 0 comments
Open

[FEA] Support strict=False casting in cudf-polars #17244

brandon-b-miller opened this issue Nov 4, 2024 · 0 comments
Assignees
Labels
cudf.polars Issues specific to cudf.polars feature request New feature or request Python Affects Python cuDF API.

Comments

@brandon-b-miller
Copy link
Contributor

PR #17076 implements casting between strings and numeric values using the polars GPU backend. However polars optionally supports the strict kwarg when casting between types which nulls out data that can't be converted from one type to the other. We should be able to implement this as a scan of the data to produce a mask that we then use to scatter NA. For instance, we could check which strings correspond to integers using libcudf's is_integer method and produce a mask that way. This should be relevant for:

  • String to numeric
  • String to datetime
  • String to boolean
  • Integer to datetime
@brandon-b-miller brandon-b-miller added cudf.polars Issues specific to cudf.polars feature request New feature or request labels Nov 4, 2024
@brandon-b-miller brandon-b-miller self-assigned this Nov 4, 2024
@github-project-automation github-project-automation bot moved this to In Progress in cuDF/Dask/Numba/UCX Nov 4, 2024
@vyasr vyasr added the Python Affects Python cuDF API. label Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cudf.polars Issues specific to cudf.polars feature request New feature or request Python Affects Python cuDF API.
Projects
Status: Todo
Status: In Progress
Development

No branches or pull requests

2 participants