Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Serve] serve build option to output Kubernetes config format #28831

Closed
shrekris-anyscale opened this issue Sep 27, 2022 · 0 comments · Fixed by #28918
Closed

[Serve] serve build option to output Kubernetes config format #28831

shrekris-anyscale opened this issue Sep 27, 2022 · 0 comments · Fixed by #28918
Labels
enhancement Request for new feature and/or capability good first issue Great starter issue for someone just starting to contribute to Ray P2 Important issue, but not time-critical serve Ray Serve Related Issue

Comments

@shrekris-anyscale
Copy link
Contributor

Description

serve build should have an option to output the config file in Kubernetes format.

Use case

serve build outputs a Serve config file that can be deployed to a Ray cluster with serve run and serve deploy:

import_path: ...

runtime_env: ...

deployments:

    - name: ...
      num_replicas: ...
      ...

    - name:
      ...

    ...

Kuberay RayServices use this config when deploying Serve. However, the KubeRay config uses camel case (see example) for the deployment options, so this config can't be directly copy-pasted.

Adding a Kubernetes output option would let users copy-paste the config directly.

@shrekris-anyscale shrekris-anyscale added enhancement Request for new feature and/or capability P2 Important issue, but not time-critical serve Ray Serve Related Issue labels Sep 27, 2022
@simon-mo simon-mo added the good first issue Great starter issue for someone just starting to contribute to Ray label Sep 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Request for new feature and/or capability good first issue Great starter issue for someone just starting to contribute to Ray P2 Important issue, but not time-critical serve Ray Serve Related Issue
Projects
None yet
2 participants