Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Datasets] Preserve Dataset type in the face of empty block lists and empty blocks. #20290

Closed
clarkzinzow opened this issue Nov 12, 2021 · 0 comments
Labels
bug Something that is supposed to be working; but isn't data Ray Data-related issues P2 Important issue, but not time-critical
Milestone

Comments

@clarkzinzow
Copy link
Contributor

When Datasets transformations result in empty block lists or empty blocks, the block (and therefore Dataset) type is dropped or incorrectly set, respectively, leading to downstream operations being unable to switch on the Dataset type in the former case, and such transformations having to manually preserve the block type in the latter case. We should try to preserve the Dataset type in general for both of these cases.

@clarkzinzow clarkzinzow added bug Something that is supposed to be working; but isn't P2 Important issue, but not time-critical labels Nov 12, 2021
@clarkzinzow clarkzinzow added this to the Datasets GA milestone Nov 12, 2021
@clarkzinzow clarkzinzow added the data Ray Data-related issues label Apr 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something that is supposed to be working; but isn't data Ray Data-related issues P2 Important issue, but not time-critical
Projects
None yet
Development

No branches or pull requests

2 participants