Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] Document and extend action mask example. #20390

Merged
merged 17 commits into from
Nov 16, 2021

Conversation

stefanbschneider
Copy link
Member

@stefanbschneider stefanbschneider commented Nov 15, 2021

Why are these changes needed?

Adds comments to document the action masking example.
Also extends the example to allow training manually without Ray tune.
And adding an option to disable masking, illustrating that invalid actions are indeed selection without masking.

Related issue number

Ongoing effort of improving and extending all examples.

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(
    • Local, manual tests

@richardliaw
Copy link
Contributor

nice work here ;)

Stefan Schneider and others added 3 commits November 16, 2021 09:19
extra line breaks in comments

Co-authored-by: Richard Liaw <[email protected]>
Extra line breaks in comments for better structure

Co-authored-by: Richard Liaw <[email protected]>
Slightly adjusted comments

Co-authored-by: Richard Liaw <[email protected]>
Copy link
Contributor

@sven1977 sven1977 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this PR, @stefanbschneider ! Really nice.

rllib/examples/models/action_mask_model.py Outdated Show resolved Hide resolved
@@ -1,61 +1,129 @@
"""Example showing how to use "action masking" in RLlib.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@sven1977
Copy link
Contributor

Waiting for tests, for merging ...

@sven1977 sven1977 changed the title [RLlib] Document and extend action mask example [RLlib] Document and extend action mask example. Nov 16, 2021
@sven1977 sven1977 added the tests-ok The tagger certifies test failures are unrelated and assumes personal liability. label Nov 16, 2021
@sven1977 sven1977 merged commit 2b3d0c6 into ray-project:master Nov 16, 2021
wuisawesome pushed a commit that referenced this pull request Nov 20, 2021
Co-authored-by: Richard Liaw <[email protected]>
Co-authored-by: Sven Mika <[email protected]>
Co-authored-by: sven1977 <[email protected]>
wuisawesome pushed a commit that referenced this pull request Nov 21, 2021
Co-authored-by: Richard Liaw <[email protected]>
Co-authored-by: Sven Mika <[email protected]>
Co-authored-by: sven1977 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
rllib RLlib related issues tests-ok The tagger certifies test failures are unrelated and assumes personal liability.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants