You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The GroupedDataset method map_groups() is missing support for callable classes.
Attempting to use a callable class with map_groups() results in the following error:
Map Progress (1 actors 1 pending): 88%|████████▊ | 7/8 [00:36<00:04, 4.69s/it]2022-06-30 20:43:20,980 ERROR worker.py:95 -- Unhandled error (suppress with 'RAY_IGNORE_UNHANDLED_ERRORS=1'): ray::BlockWorker.map_block_nosplit() (pid=73870, ip=172.28.0.2, repr=<ray.data.impl.compute.BlockWorker object at 0x7ffb4136d5d0>)
File "/usr/local/lib/python3.7/dist-packages/ray/data/impl/compute.py", line 185, in map_block_nosplit
return _map_block_nosplit(block, fn, input_files)
File "/usr/local/lib/python3.7/dist-packages/ray/data/impl/compute.py", line 341, in _map_block_nosplit
for new_block in fn(block):
File "/usr/local/lib/python3.7/dist-packages/ray/data/dataset.py", line 355, in transform
applied = fn(view)
File "/usr/local/lib/python3.7/dist-packages/ray/data/grouped_dataset.py", line 259, in group_fn
applied = fn(group)
TypeError: __init__() takes 1 positional argument but 2 were given
The text was updated successfully, but these errors were encountered:
thatcort
added
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
labels
Jul 1, 2022
clarkzinzow
added
P2
Important issue, but not time-critical
data
Ray Data-related issues
and removed
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
labels
Jul 8, 2022
jianoaix
changed the title
[data] GroupedDataset.map_groups() Doesn't Support Callable Classes
[Datasets] GroupedDataset.map_groups() Doesn't Support Callable Classes
Aug 29, 2022
What happened + What you expected to happen
The GroupedDataset method map_groups() is missing support for callable classes.
Attempting to use a callable class with map_groups() results in the following error:
https://ray-distributed.slack.com/archives/C01DLHZHRBJ/p1656626491260859?thread_ts=1656616666.457479&cid=C01DLHZHRBJ
Versions / Dependencies
This is using Ray 1.13.0 and Pyarrow 6.0.1 on Python 3.7.13
Reproduction script
Issue Severity
No response
The text was updated successfully, but these errors were encountered: