Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Jobs] Update CLI examples to use the same setup #20844

Merged
merged 2 commits into from
Dec 6, 2021

Conversation

jiaodong
Copy link
Member

@jiaodong jiaodong commented Dec 2, 2021

Why are these changes needed?

Current docs https://docs.ray.io/en/master/ray-job-submission/overview.html started with CLI but is a very minimal example. This changes it to the better script.py one, same for SDK.

Related issue number

Closes #20835

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@jiaodong jiaodong added the serve Ray Serve Related Issue label Dec 2, 2021
@@ -64,6 +64,8 @@ We can put this file in a local directory of your choice, with filename "script.

.. code-block:: bash

export RAY_RUNTIME_ENV_LOCAL_DEV_MODE="1" # If you're using locally build version of ray
Copy link
Contributor

@edoakes edoakes Dec 3, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please don't add this to public docs, this is an internal developer feature

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I initial tried without using this flag but got stuck on setting up runtime env after submitting a job, and ray log's runtime_env mentions setting this to 1. Can we assume readers of this doc always use a public release ? Not sure if it's common that external ray developers are using v2.0.0dev

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc: @architkulkarni i remember you told me about setting this flag in case user is using runtime_env pip install with v2.0.0dev

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah yeah I think we should assume users are using a released version and at most add a small footnote for people who aren't

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, that flag is only necessary when using runtime env locally built from source. You don't need it when using any pre-built Ray wheel, including the nightly wheels, even though these are v2.0.0dev. (Basically any wheel that has ray.__commit__ set which can be downloaded from our AWS bucket using the standard URL format.). This is useful because users do often use nightly wheels to get certain bugfixes. (I think it's significantly rarer for them to build from source)

@edoakes edoakes added the @author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. label Dec 6, 2021
@edoakes
Copy link
Contributor

edoakes commented Dec 6, 2021

ping @jiaodong to remove env var then LGTM

@edoakes edoakes merged commit e065f2e into ray-project:master Dec 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
@author-action-required The PR author is responsible for the next step. Remove tag to send back to the reviewer. serve Ray Serve Related Issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update jobs document to use better example for cli
4 participants