Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RLlib; Offline RL] Make data pipeline better configurable and tuneable for users. #46777

Merged
merged 7 commits into from
Jul 25, 2024
Merged

[RLlib; Offline RL] Make data pipeline better configurable and tuneable for users. #46777

merged 7 commits into from
Jul 25, 2024
+365 −248

Commits on Jul 24, 2024

  1. Added annotations and seprated 'OfflineData' and 'OfflinePreLearner' … 

    …class into separate files.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    4d40a17 View commit details
    Browse the repository at this point in the history

  2. Added 'map_batches_kwargs' and 'iter_batches_kwargs' arguments to 'Al… 

    …gorithmConfig' and 'OfflineData' to make the data pipeline better configurable and tuneable. Tested single-and multi-learner sertups with BC.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    147a512 View commit details
    Browse the repository at this point in the history

  3. Update rllib/algorithms/algorithm_config.py 

    Co-authored-by: Sven Mika <[email protected]>
Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980 @sven1977
    simonsays1980 and sven1977 authored Jul 24, 2024
    Configuration menu
    Copy the full SHA
    dfbff75 View commit details
    Browse the repository at this point in the history

  4. Added comments and docstring as requested in @sven1977's review. 

    Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    d8738da View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Merge branch 'master' into add-user-defined-pre-learner

    @simonsays1980
    simonsays1980 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    27145d9 View commit details
    Browse the repository at this point in the history

  2. Fixed an import bug due to separating 'OfflinePreLearner' into its ow… 

    …n class.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    211668a View commit details
    Browse the repository at this point in the history

  3. Added a safeguard for the case 'train_batch_size_per_learner' is not … 

    …defined.

Signed-off-by: simonsays1980 <[email protected]>
    @simonsays1980
    simonsays1980 committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    119c475 View commit details
    Browse the repository at this point in the history