You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to train image input rl policy with stable baseline3 and I have this wrapper to make image into right shape. I tried to keep the image stay on gpu to make the training faster by set image_on_cuda to be True but the gym box doesn't accept cupy array or torch tensor.
My question is is there any other way to make image on cuda work without transferring the data back to cpu. If not, would it be better that I turn off image_on_cuda and just use cpu to do the interaction with environment?
The text was updated successfully, but these errors were encountered:
Hello,
I'm trying to train image input rl policy with stable baseline3 and I have this wrapper to make image into right shape. I tried to keep the image stay on gpu to make the training faster by set image_on_cuda to be True but the gym box doesn't accept cupy array or torch tensor.
My question is is there any other way to make image on cuda work without transferring the data back to cpu. If not, would it be better that I turn off image_on_cuda and just use cpu to do the interaction with environment?
The text was updated successfully, but these errors were encountered: