Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use KvikIO when available even when GDS isn't available #1206

Open
madsbk opened this issue Jun 28, 2023 · 0 comments
Open

Use KvikIO when available even when GDS isn't available #1206

madsbk opened this issue Jun 28, 2023 · 0 comments

Comments

@madsbk
Copy link
Member

madsbk commented Jun 28, 2023

Currently, we only enable KvikIO for spilling-to-disk when GDS hardware is available:

dask-cuda/dask_cuda/disk_io.py

Line 124 in 5a3c57f

self.gds_enabled = gds or dask.config.get("gds-spilling", default=False)

Since KvikIO accelerate GPU IO even when GDS hardware isn't available, we could use KvikIO as long as import kvikio doesn't fail.

cc. @jakirkham
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@madsbk