Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Cherry-pick][RayJob] Add default CPU and memory for job submitter pod (#1319) #1518

Merged
merged 1 commit into from
Oct 17, 2023

Commits on Oct 17, 2023

  1. [RayJob] Add default CPU and memory for job submitter pod (ray-projec…

    …t#1319)
    
    Adds a default CPU and memory resource requirement for the pod that submits the RayJob.
    
    image
    Here's the memory and CPU usage of the job submitter pod with a job entrypoint script that prints "hello world" in a tight loop from Python. I tested it on a local kind cluster. Since the job submitter pod just calls ray job submit which runs the job remotely and streams the job output to stdout on the submitter pod, this kind of log streaming job should be the most stressful from the perspective of the job submitter pod.
    
    Based on this, we set the requests to 500m CPU and 200MiB memory, and set the limits to 1 CPU and 1GiB memory.
    
    Why are these changes needed?
    It's good to provide reasonable defaults to reduce the burden on the user.
    
    Related issue number
    Closes ray-project#1198
    
    ---------
    
    Signed-off-by: Archit Kulkarni <[email protected]>
    architkulkarni authored and kevin85421 committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    7adf247 View commit details
    Browse the repository at this point in the history