[Doc] [KubeRay] Add end-to-end tutorial for real-world RayJob workload (batch inference) #38857
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…nchmark.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
…nchmark.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
…nchmark.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
…nchmark.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Kai-Hsun Chen <[email protected]>
|
Do you want to add this example to the Examples Gallery? Instructions are at go/example-gallery. |
|
Thanks for the review!
@angelinalg I'm not sure how to decide. Should all examples be in the gallery or is there some criteria? Also, would you tag this with code-example or tutorial? |
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
…example.md Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
|
Test failure tests:test_object_assign_owner_client_mode unrelated |
architkulkarni
added
the
tests-ok
architkulkarni
added a commit
to architkulkarni/ray
that referenced
this pull request
Aug 31, 2023
…d (batch inference) (ray-project#38857) This PR adds a tutorial for running a batch inference workload on KubeRay using the RayJob CRD. It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE. --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]>
8 tasks
GeneDer
pushed a commit
that referenced
this pull request
Sep 1, 2023
…38857) (#39186) * [Doc] [KubeRay] Add tutorial for connecting to google cloud storage bucket from GKE RayCluster (#38858) This PR adds a self contained tutorial for connecting to a google cloud storage bucket. (Mostly self contained, we do link out to the google cloud docs for creating a bucket.) --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]> * [Doc] [KubeRay] Add end-to-end tutorial for real-world RayJob workload (batch inference) (#38857) This PR adds a tutorial for running a batch inference workload on KubeRay using the RayJob CRD. It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE. --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]>
LeonLuttenberger
pushed a commit
to jaidisido/ray
that referenced
this pull request
Sep 5, 2023
…d (batch inference) (ray-project#38857) This PR adds a tutorial for running a batch inference workload on KubeRay using the RayJob CRD. It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE. --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]>
jimthompson5802
pushed a commit
to jimthompson5802/ray
that referenced
this pull request
Sep 12, 2023
…d (batch inference) (ray-project#38857) This PR adds a tutorial for running a batch inference workload on KubeRay using the RayJob CRD. It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE. --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]> Signed-off-by: Jim Thompson <[email protected]>
vymao
pushed a commit
to vymao/ray
that referenced
this pull request
Oct 11, 2023
…d (batch inference) (ray-project#38857) This PR adds a tutorial for running a batch inference workload on KubeRay using the RayJob CRD. It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE. --------- Signed-off-by: Kai-Hsun Chen <[email protected]> Signed-off-by: Archit Kulkarni <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: Kai-Hsun Chen <[email protected]> Co-authored-by: angelinalg <[email protected]> Signed-off-by: Victor <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why are these changes needed?
This PR adds a tutorial for running a batch inference workload on KubeRay using the
RayJobCRD.It also updates the GPU/GKE doc (which is used as a subroutine in this tutorial) to remove the instructions related to taints and tolerations and GPU driver installation, both of which are currently handled automatically by GKE.
Related issue number
Checks
git commit -s) in this PR.scripts/format.shto lint the changes in this PR.method in Tune, I've added it in
doc/source/tune/api/under thecorresponding
.rstfile.