-
Notifications
You must be signed in to change notification settings - Fork 5.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[RLlib] Add examples and docs for Catalog #33898
Changes from 7 commits
a0a3445
8e30ab9
7c5dc31
ded1db1
dfcf353
e1da6a5
ac0912a
b85d855
fb2c083
b9518fc
192b106
da08bbe
2a7cb5e
1772715
a9b86c1
fdb2bcf
bd71be7
a91928b
5abb2b6
6d93736
5066830
342af33
06af93e
4eeb143
f69b93b
8f3a57d
b722b20
b2414cf
65bebb5
8025462
fae6c2b
07114e9
f90a043
607b132
d71c5a2
6260b00
1610b13
8fb152c
cbce31f
0cca86b
41dc7b0
5d7608c
deaaca5
c80a4e9
4a16d73
5eb5f2f
d07f219
6d562ad
766ac2f
2a16afb
a819a05
a375bf3
d1a3fe3
ac00433
8454f7c
b29b5bc
4524cd4
24e2650
048a01d
92df6eb
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
.. | ||
.. admonition:: This doc is related to the RLModules API. | ||
|
||
Disregard this doc if you do not explicitly want to use RLModules. The RLModules API is experimental and | ||
only being rolled out across RLlib. It is not yet recommended for general until it is fully rolled out. |
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -287,7 +287,7 @@ parts: | |
title: Ray RLlib | ||
sections: | ||
- file: rllib/rllib-training | ||
- file: rllib/core-concepts | ||
- file: rllib/key-concepts | ||
- file: rllib/rllib-env | ||
- file: rllib/rllib-algorithms | ||
- file: rllib/user-guides | ||
|
@@ -299,6 +299,7 @@ parts: | |
- file: rllib/rllib-sample-collection | ||
- file: rllib/rllib-replay-buffers | ||
- file: rllib/rllib-offline | ||
- file: rllib/rllib-catalogs | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Let's put this under user-guide for now. It's not a key concept yet since it's experimental. We have to later re-structure the key-concepts page to have better navigation around topics. |
||
- file: rllib/rllib-connector | ||
- file: rllib/rllib-fault-tolerance | ||
- file: rllib/rllib-dev | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The name of the object behind "action space" is difficult to read. I think it's the "observation space"? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yeah. It's not meant to be readable. It's a bunch of things that are described above that go into the Catalog. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Should we change this? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We could probably just say something to the effect of RLModules is an experimental API. I think this gets across the point overall. Its implied what experimental means.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you provide a complete sentence to replace this with?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The RLModules api is currently in the experimental phase of its rollout.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hmm while we're at it, is this a whole separate doc page right here? If so, why?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's an include. It's basically a banner that alerts users that they are looking at something experimental.
Angelina told me to make this basically the first thing people read - if it's not meant for John Doe, put it first.
CC @kouroshHakha to make you aware of this banner