Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[serve] Add Ray API stability annotations #17295

Merged
merged 7 commits into from
Jul 27, 2021
Merged

[serve] Add Ray API stability annotations #17295

merged 7 commits into from
Jul 27, 2021

Conversation

edoakes
Copy link
Contributor

@edoakes edoakes commented Jul 23, 2021 •
edited
Loading

Why are these changes needed?

Add stability annotations recently generalized from RLlib.

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@edoakes
Copy link
Contributor Author

edoakes commented Jul 23, 2021

@ericl this looks pretty good. I don't think we have anything that fits into the DeveloperAPI category (yet)

simon-mo
simon-mo approved these changes Jul 23, 2021
View reviewed changes
Copy link
Contributor

@simon-mo simon-mo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM looks great

ericl
ericl reviewed Jul 23, 2021
View reviewed changes
python/ray/serve/api.py Outdated Show resolved Hide resolved
ericl
ericl requested changes Jul 23, 2021
View reviewed changes
Copy link
Contributor

@ericl ericl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove ray.util.annotations. prefix for consistency with other uses of the annotation

@ericl ericl added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Jul 23, 2021
@edoakes edoakes removed the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Jul 26, 2021
@edoakes edoakes changed the title [WIP][serve] Add Ray API stability annotations [serve] Add Ray API stability annotations Jul 26, 2021
@ericl ericl added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Jul 26, 2021
@edoakes edoakes merged commit 7225f28 into ray-project:master Jul 27, 2021
stephanie-wang pushed a commit to stephanie-wang/ray that referenced this pull request Jul 31, 2021
@edoakes @stephanie-wang
[serve] Add Ray API stability annotations (ray-project#17295)
e0d47e8
DmitriGekhtman pushed a commit that referenced this pull request Aug 3, 2021
@sasha-s @AmeerHajAli
@clay4megtr @edoakes @simon-mo @amogkam @richardliaw @sven1977 @Yard1 @Rohan138 @amavilla @jiaodong @juliusfrost @ericl @kk-55 @fishbone @matthewdeng
[autoscaler] Enforce per-node-type max workers (#17352)
5dbbaf7 
* Enforce per-node-type max workers

* type annonation

Co-authored-by: Ameer Haj Ali <[email protected]>

* cleanup. comments. type annotations

* additional type annotation

Co-authored-by: Ameer Haj Ali <[email protected]>

* additional cleanup. comments. type annotations

* _get_nodes_needed_for_request_resources to use FrozenSet

* comments

* whitespace

* [Placement Group] Fix resource index assignment between with bundle index and without bundle index pg (#17318)

* [serve] Add Ray API stability annotations (#17295)

* Support streaming output of runtime env setup to logger/driver (#17306)

* [SGD] v2 prototype: ``WorkerGroup`` implementation (#17330)

* wip

* formatting

* increase timeouts

* address comments

* comments

* fix

* address comments

* Update python/ray/util/sgd/v2/worker_group.py

Co-authored-by: Richard Liaw <[email protected]>

* Update python/ray/util/sgd/v2/worker_group.py

Co-authored-by: Richard Liaw <[email protected]>

* address comments

* formatting

* fix

* avoid race condition

Co-authored-by: Richard Liaw <[email protected]>

* [RLlib] Discussion 3001: Fix comment on internal state shape (must be [B x S=state dim]). (#17341)

* [autoscaler] GCP TPU VM autoscaler (#17278)

* [Rllib] set self._allow_unknown_config (#17335)

Co-authored-by: Sven Mika <[email protected]>

* [RLlib] Discussion 2294: Custom vector env example and fix. (#16083)

* [docs] Link broken in Tune's page (#17394) (#17407)

* [Serve] Fix response_model for class based view routes as well (#17376)

* [serve] Fix single deployment nightly test (#17368)

* [RLlib] SAC tuple observation space fix (#17356)

* Support schema on read for csv/json (#17354)

* [RLlib] New and changed version of parametric actions cartpole example + small suggested update in policy_client.py (#15664)

* [gcs] Fix GCS related issues: ByteSizeLong and redis connection (#17373)

* [runtime_env] Gracefully fail tasks when an environment fails to be set up (#17249)

* [docs] update docs with pip requirements (#17317)

* removed nodes_to_keep. cleanup

* formatting

* +comment

* treat max_workers=0 as 0 workers (as opposed to unlimited)

* fix wrong comment

* warning for inconsistent config

* terminate nodes with no matching node type right away

* quotes

* special handling for head node when enforcing max_workers per type. tests. cleanup

* cleanup comments and prints

* comments

* cleanup. removed special handling of head node.

* adding an eplicit non-None check in schedule_node_termination

* raise the exception

Co-authored-by: Ameer Haj Ali <[email protected]>

Co-authored-by: Ameer Haj Ali <[email protected]>
Co-authored-by: DK.Pino <[email protected]>
Co-authored-by: Edward Oakes <[email protected]>
Co-authored-by: Simon Mo <[email protected]>
Co-authored-by: Amog Kamsetty <[email protected]>
Co-authored-by: Richard Liaw <[email protected]>
Co-authored-by: Sven Mika <[email protected]>
Co-authored-by: Antoni Baum <[email protected]>
Co-authored-by: Rohan138 <[email protected]>
Co-authored-by: amavilla <[email protected]>
Co-authored-by: Jiao <[email protected]>
Co-authored-by: Julius Frost <[email protected]>
Co-authored-by: Eric Liang <[email protected]>
Co-authored-by: kk-55 <[email protected]>
Co-authored-by: Yi Cheng <[email protected]>
Co-authored-by: matthewdeng <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@simon-mo simon-mo simon-mo approved these changes

@ericl ericl ericl approved these changes

Assignees

@ericl ericl

@simon-mo simon-mo

Labels
@author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@edoakes @ericl @simon-mo