Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Datasets] Handle np.array(dtype=object) constructor for ragged ndarrays #31670

Merged
merged 2 commits into from
Jan 14, 2023

Conversation

scottjlee
Copy link
Contributor

@scottjlee scottjlee commented Jan 13, 2023

Signed-off-by: Scott Lee [email protected]

Why are these changes needed?

This is a rework of #31544, which was reverted because of broken CI tests (bad pandas import). We replicate the aforementioned PR, with an additional TYPE_CHECKING usage to only import from pandaswhen type-checking.

Related issue number

Rework of PR #31544

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Signed-off-by: Scott Lee <[email protected]>
@c21
Copy link
Contributor

c21 commented Jan 13, 2023

@scottjlee - could you point out which code change in this PR is newly added, compared to previous committed PR?


import numpy as np

if TYPE_CHECKING:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the new section added in this PR. The rest of the code changes are exactly the same as from the previous PR

@scottjlee
Copy link
Contributor Author

@scottjlee - could you point out which code change in this PR is newly added, compared to previous committed PR?

Thanks for the reminder, just added a comment in the new section of code.

Copy link
Contributor

@c21 c21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG

@clarkzinzow clarkzinzow merged commit f91c7a2 into ray-project:master Jan 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants