Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib; Offline RL] Offline recording new api stack #46818

Merged
merged 11 commits into from
Aug 1, 2024
Merged

[RLlib; Offline RL] Offline recording new api stack #46818

merged 11 commits into from
Aug 1, 2024

Commits on Jul 25, 2024

  1. Initial commit. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    de7b158 View commit details
    Browse the repository at this point in the history

  2. LINTER. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    1adeddd View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Implemented sampling in 'OfflineSingleAgentEnvRunner' and tested it. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    7f4d0bf View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. Merge branch 'master' into offline-recording-new-api-stack

    @simonsays1980
    simonsays1980 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    db024b5 View commit details
    Browse the repository at this point in the history

  2. Added 'max_num_rows', and added filesystem to write method kwargs. Fu… 

    …rthermore, tested running 'truncate_episodes' batch mode.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    85aec67 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Refactored 'OfflineEnvRunner' to call 'super' for sampling and loop t… 

    …hrough sampled episodes.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    2acf0b3 View commit details
    Browse the repository at this point in the history

  2. Added writing of episodes and some small nits. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    d119778 View commit details
    Browse the repository at this point in the history

  3. fix 

    Signed-off-by: sven1977 <[email protected]>
    @sven1977
    sven1977 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f754bbf View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Added @sven1977's review. Renamed some offline arguments and class at… 

    …tributes ofr and in the 'OfflineEnvRunner'.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e2ac925 View commit details
    Browse the repository at this point in the history

  2. Merged Remote. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    4d38aae View commit details
    Browse the repository at this point in the history

  3. Some smaller nits like renaming and removing an import. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    324cd67 View commit details
    Browse the repository at this point in the history