You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'd like to change from a hardcoding of nvidia.com/gpu to instead having a dict or something of resources. There are other accelerators and it'd be nice to specify them with an arbitrary key/value rather than hardcoding nvidia.com/gpu
Description of Problem the Feature Should Solve
Currently hardcoding nvidia.com/gpu is suboptimal since there are other accelerators, habana.ai/gaudi to name one, but there are other potential resources and accelerators, some possibly even not public. It would be a benefit to usability to specify these additional resources without editing the template.
Which would just add the keys/values from the resources variable into the resources requests/limits section. Perhaps an option to set requests/limits separately something like for splitting, but first pass it's totally fine if it's just requests == limits since for hardware devices it's required they be equal
Describe Alternatives You Have Considered
Some alternative format ideas are maybe something like min_resources and max_resources, or a string format like "someresource": "1/2" for request 1 limit 2, etc.
Additional Context
In this case, the request is around Habana Gaudi devices, but the scope exists beyond that
The text was updated successfully, but these errors were encountered:
Name of Feature or Improvement
I'd like to change from a hardcoding of
nvidia.com/gpu
to instead having a dict or something of resources. There are other accelerators and it'd be nice to specify them with an arbitrary key/value rather than hardcodingnvidia.com/gpu
Description of Problem the Feature Should Solve
Currently hardcoding
nvidia.com/gpu
is suboptimal since there are other accelerators,habana.ai/gaudi
to name one, but there are other potential resources and accelerators, some possibly even not public. It would be a benefit to usability to specify these additional resources without editing the template.Describe the Solution You Would Like to See
I'd like to see a constructor something like:
Which would just add the keys/values from the resources variable into the resources requests/limits section. Perhaps an option to set requests/limits separately something like for splitting, but first pass it's totally fine if it's just requests == limits since for hardware devices it's required they be equal
Describe Alternatives You Have Considered
Some alternative format ideas are maybe something like min_resources and max_resources, or a string format like "someresource": "1/2" for request 1 limit 2, etc.
Additional Context
In this case, the request is around Habana Gaudi devices, but the scope exists beyond that
The text was updated successfully, but these errors were encountered: