Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tune] Access to more detailed resource management information #17799

Closed
xwjiang2010 opened this issue Aug 12, 2021 · 4 comments
Closed

[Tune] Access to more detailed resource management information #17799

xwjiang2010 opened this issue Aug 12, 2021 · 4 comments
Labels
enhancement Request for new feature and/or capability

Comments

@xwjiang2010
Copy link
Contributor

xwjiang2010 commented Aug 12, 2021

This is to improve Tune usability, namely we should not just let user be stuck in PENDING state. The current PlacementGroup API is very reactive. Tune doesn't know if a certain request is ever gonna be fulfilled or not. Since autoscaler has access to cluster.yaml and has an overview understanding of the resource requests, ideally it should signal if a request cannot be met at all.

For context, see discussions under
https://github.com/ray-project/ray/pull/17533/files/d6150e7f8b3a3b2b64cc056abf45f8e6642e4056#diff-4ed0b87c19cc0a24e8ab5747e611efa147b689312489ad4acfe604d05f17e7ac

which resource is not available, and how much is being requested
what is the total amount of those resource available on the cluster

@xwjiang2010 xwjiang2010 added the enhancement Request for new feature and/or capability label Aug 12, 2021
@xwjiang2010
Copy link
Contributor Author

@xwjiang2010
Copy link
Contributor Author

@wuisawesome as well. Mingwei mentioned this may fit in Ray Scheduler.

@wuisawesome
Copy link
Contributor

Btw there was some discussion around this in #14908 but it's worth revisiting if requirements have changed. I suspect this will be somewhat involved though.

@xwjiang2010
Copy link
Contributor Author

Duped with #18018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Request for new feature and/or capability
Projects
None yet
Development

No branches or pull requests

2 participants