Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use all available RunPod regions by default #1573

Closed
Tracked by #1735
jvstme opened this issue Aug 19, 2024 · 2 comments · Fixed by #1757
Closed
Tracked by #1735

Use all available RunPod regions by default #1573

jvstme opened this issue Aug 19, 2024 · 2 comments · Fixed by #1757

Comments

@jvstme
Copy link
Collaborator

jvstme commented Aug 19, 2024

Current

The RunPod backend only uses a fixed set of regions by default.

REGIONS = [
    "CA-MTL-1",
    "EU-NL-1",
    "EU-RO-1",
    "EU-SE-1",
    "EUR-IS-1",
    "EUR-IS-2",
    "EUR-NO-1",
    "US-OR-1",
]

This leads to poorer GPUs availability, e.g. NVIDIA H100 NVL (94GB) is only available in US-KS-2 that is not used by default.

Proposed

Allow using all existing regions unless a specific set of regions is configured in .dstack/server/config.yml.

@jvstme jvstme added the ux label Aug 19, 2024
Copy link

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale label Sep 19, 2024
IshuSinghSE pushed a commit to IshuSinghSE/dstack that referenced this issue Oct 1, 2024
r4victor pushed a commit that referenced this issue Oct 3, 2024
* Fix Handle KeyboardInterrupt in CLI when getting run plan #1626

* Allow using all existing regions unless a specific set of regions is configured #1573

* Delete src/dstack/_internal/cli/commands/apply.py

* Revert "Delete src/dstack/_internal/cli/commands/apply.py"

This reverts commit 0e6a938.

* Fix use all available runpod regions by default

---------

Co-authored-by: Ishu Singh <[email protected]>
@r4victor
Copy link
Collaborator

r4victor commented Oct 3, 2024

Note that the fix introduced in #1757 requires the backend config to be updated to use all regions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants