Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AIR] Enable GPU prediction #25111

Closed
amogkam opened this issue May 24, 2022 · 1 comment
Closed

[AIR] Enable GPU prediction #25111

amogkam opened this issue May 24, 2022 · 1 comment
Assignees
@jiaodong
Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks
Milestone
Ray AIR

Comments

@amogkam
Copy link
Contributor

amogkam commented May 24, 2022

Description

Predictors for neural network inference (TorchPredictor, TFPredictor) can often leverage GPUs for inference (either offline or online).

Currently our deep learning predictors do not provide the ability to move the model to a GPU device for prediction.

Use case

GPU inference with AIR predictors.
@amogkam amogkam added enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks air labels May 24, 2022
@amogkam amogkam added this to the Ray AIR milestone May 24, 2022
@ericl
Copy link
Contributor

ericl commented Jul 15, 2022

Closed by #26251

@ericl ericl closed this as completed Jul 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jiaodong jiaodong

Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks
Projects
None yet
Milestone
Ray AIR
Development

No branches or pull requests
3 participants
@ericl @jiaodong @amogkam