Distributed barrier in Jax
#22299
-
|
I'm doing some dataset preprocessing and hence want to sync up all the jax processes on every node/host. However, that experimental capability has been phased out. How can I use a barrier? And if that's not possible, how can I increase the timeout of the |
Beta Was this translation helpful? Give feedback.
Answered by
yashk2810
Jul 10, 2024
Replies: 1 comment 1 reply
-
|
Try using |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
That's it - thank you so much! |
Beta Was this translation helpful? Give feedback.
Answer selected by
neel04
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Try using
multihost_utils.sync_global_devices?