Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(statistics tools): support statistics tools for experiments launched by omnisafe #157

Merged
merged 49 commits into from
Mar 27, 2023
Merged

feat(statistics tools): support statistics tools for experiments launched by omnisafe #157

merged 49 commits into from
Mar 27, 2023

Commits on Mar 14, 2023

  1. refactor: change architecture of omnisafe (PKU-Alignment#121)

    @rockmagma02 @zmsn-2077
    rockmagma02 authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    4987e80 View commit details
    Browse the repository at this point in the history

  2. fix(algo): fix no return in algo_wrapper::learn (PKU-Alignment#122)

    @rockmagma02 @zmsn-2077
    rockmagma02 authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    90f7549 View commit details
    Browse the repository at this point in the history

  3. chore: support num_thread setting (PKU-Alignment#124)

    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    16be6a8 View commit details
    Browse the repository at this point in the history

  4. feat: update architecture of config.yaml (PKU-Alignment#126)

    @zmsn-2077
    zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    51e7f96 View commit details
    Browse the repository at this point in the history

  5. fix(logger, wrapper): support csv file and velocity tasks (PKU-Alignm… 

    …ent#131)
    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    2aa1417 View commit details
    Browse the repository at this point in the history

  6. chore: fix typo. (PKU-Alignment#134)

    @1Asan @zmsn-2077
    1Asan authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    04477eb View commit details
    Browse the repository at this point in the history

  7. fix(ppo): fix entropy loss (PKU-Alignment#135)

    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    fe686bb View commit details
    Browse the repository at this point in the history

  8. test: add more test case, and fix bugs (PKU-Alignment#136)

    @rockmagma02 @zmsn-2077
    rockmagma02 authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    63dc035 View commit details
    Browse the repository at this point in the history

  9. fix: support new config for exp_grid (PKU-Alignment#142) 

    Co-authored-by: borong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @muchvo @pre-commit-ci @zmsn-2077
    3 people authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    8b32d73 View commit details
    Browse the repository at this point in the history

  10. feat: support policy evaluation (PKU-Alignment#137) 

    Co-authored-by: ruiyang sun <[email protected]>
    @Gaiejj @rockmagma02 @zmsn-2077
    2 people authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    06dcbdb View commit details
    Browse the repository at this point in the history

  11. feat(off-policy): add DDPG, TD3 SAC (PKU-Alignment#128) 

    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ruiyang sun <[email protected]>
    @Gaiejj @pre-commit-ci
    @rockmagma02 @zmsn-2077
    3 people authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    c232fcf View commit details
    Browse the repository at this point in the history

  12. fix(rollout, exp_grid): fix logdir path conflict (PKU-Alignment#145) 

    Co-authored-by: zmsn-2077 <[email protected]>
Co-authored-by: borong <[email protected]>
Co-authored-by: friedmainfunction <[email protected]>
    @muchvo @zmsn-2077 @friedmainfunction
    4 people committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    78ec6bd View commit details
    Browse the repository at this point in the history

  13. fix(on-policy): fix the second order algorithms performance (PKU-Alig… 

    …nment#147)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @Gaiejj @pre-commit-ci @zmsn-2077
    2 people authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    817edf9 View commit details
    Browse the repository at this point in the history

  14. chore(on-policy): update benchmark performance for first-order algori… 

    …thms (PKU-Alignment#148)

Co-authored-by: borong <[email protected]>
Co-authored-by: Gaiejj <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: zmsn-2077 <[email protected]>
    @muchvo @Gaiejj
    @pre-commit-ci @zmsn-2077
    5 people committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    d7233ce View commit details
    Browse the repository at this point in the history

  15. docs: update README.md (PKU-Alignment#149)

    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    cb633d6 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. docs: update changelog and release v0.1.0

    @zmsn-2077
    zmsn-2077 committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    ba48512 View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2023

  1. chore: update yaml (PKU-Alignment#155)

    @Gaiejj
    Gaiejj authored Mar 17, 2023
    Configuration menu
    Copy the full SHA
    8463ca5 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2023

  1. chore: update github workflow (PKU-Alignment#156)

    @Gaiejj
    Gaiejj authored Mar 18, 2023
    Configuration menu
    Copy the full SHA
    5068262 View commit details
    Browse the repository at this point in the history

  2. feat: support command line interfaces for omnisafe (PKU-Alignment#144) 

    Co-authored-by: borong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ruiyang sun <[email protected]>
Co-authored-by: zmsn-2077 <[email protected]>
Co-authored-by: friedmainfunction <[email protected]>
Co-authored-by: Gaiejj <[email protected]>
Co-authored-by: zmsn-2077 <[email protected]>
Co-authored-by: Ruiyang Sun <[email protected]>
Co-authored-by: Jiayi Zhou <[email protected]>
Co-authored-by: 1Asan <[email protected]>
fix(algo): fix no return in algo_wrapper::learn (PKU-Alignment#122)
fix(logger, wrapper): support csv file and velocity tasks (PKU-Alignment#131)
fix typo. (PKU-Alignment#134)
fix(ppo): fix entropy loss (PKU-Alignment#135)
fix bugs (PKU-Alignment#136)
fix: support new config for exp_grid (PKU-Alignment#142)
fix(rollout, exp_grid): fix logdir path conflict (PKU-Alignment#145)
fix(on-policy): fix the second order algorithms performance (PKU-Alignment#147)
    @muchvo @pre-commit-ci
    @rockmagma02 @zmsn-2077 @friedmainfunction @Gaiejj @1Asan
    10 people authored Mar 18, 2023
    Configuration menu
    Copy the full SHA
    3c2daf0 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2023

  1. fix(onpolicy_adapter): fix the calculation of last state value (PKU-A… 

    …lignment#162)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: borong <[email protected]>
    @Dtrc2207 @pre-commit-ci @muchvo
    3 people authored Mar 19, 2023
    Configuration menu
    Copy the full SHA
    973b363 View commit details
    Browse the repository at this point in the history

  2. chore: update yaml (PKU-Alignment#155)

    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 19, 2023
    Configuration menu
    Copy the full SHA
    60c901e View commit details
    Browse the repository at this point in the history

  3. chore: update github workflow (PKU-Alignment#156)

    @Gaiejj @zmsn-2077
    Gaiejj authored and zmsn-2077 committed Mar 19, 2023
    Configuration menu
    Copy the full SHA
    d955dd8 View commit details
    Browse the repository at this point in the history

  4. feat: support command line interfaces for omnisafe (PKU-Alignment#144) 

    Co-authored-by: borong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ruiyang sun <[email protected]>
Co-authored-by: zmsn-2077 <[email protected]>
Co-authored-by: friedmainfunction <[email protected]>
Co-authored-by: Gaiejj <[email protected]>
Co-authored-by: zmsn-2077 <[email protected]>
Co-authored-by: Ruiyang Sun <[email protected]>
Co-authored-by: Jiayi Zhou <[email protected]>
Co-authored-by: 1Asan <[email protected]>
fix(algo): fix no return in algo_wrapper::learn (PKU-Alignment#122)
fix(logger, wrapper): support csv file and velocity tasks (PKU-Alignment#131)
fix typo. (PKU-Alignment#134)
fix(ppo): fix entropy loss (PKU-Alignment#135)
fix bugs (PKU-Alignment#136)
fix: support new config for exp_grid (PKU-Alignment#142)
fix(rollout, exp_grid): fix logdir path conflict (PKU-Alignment#145)
fix(on-policy): fix the second order algorithms performance (PKU-Alignment#147)
    @muchvo @pre-commit-ci
    @rockmagma02 @zmsn-2077 @friedmainfunction @Gaiejj @1Asan
    10 people committed Mar 19, 2023
    Configuration menu
    Copy the full SHA
    12dbced View commit details
    Browse the repository at this point in the history

  5. fix(onpolicy_adapter): fix the calculation of last state value (PKU-A… 

    …lignment#162)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: borong <[email protected]>
    @Dtrc2207 @pre-commit-ci
    @muchvo @zmsn-2077
    3 people authored and zmsn-2077 committed Mar 19, 2023
    Configuration menu
    Copy the full SHA
    eb45923 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'PKU-MARL:dev' into dev

    @muchvo
    muchvo authored Mar 19, 2023
    Configuration menu
    Copy the full SHA
    afdb8bc View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2023

  1. fix(onpolicy_adapter): fix the calculation of last state value (PKU-A… 

    …lignment#164)

Co-authored-by: borong <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @muchvo @pre-commit-ci
    3 people authored Mar 20, 2023
    Configuration menu
    Copy the full SHA
    4d96546 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'PKU-MARL:dev' into dev

    @muchvo
    muchvo authored Mar 20, 2023
    Configuration menu
    Copy the full SHA
    ae3e086 View commit details
    Browse the repository at this point in the history

  3. feat: support cuda (PKU-Alignment#163)

    @Gaiejj
    Gaiejj authored Mar 20, 2023
    Configuration menu
    Copy the full SHA
    2f04f4a View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. Merge branch 'PKU-MARL:dev' into dev

    @muchvo
    muchvo authored Mar 21, 2023
    Configuration menu
    Copy the full SHA
    3617289 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. docs: update docs style (PKU-Alignment#169)

    @Gaiejj
    Gaiejj authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    9fa17e5 View commit details
    Browse the repository at this point in the history

  2. fix(config.py): fix config assertion (PKU-Alignment#174)

    @Gaiejj
    Gaiejj authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    5e66a6e View commit details
    Browse the repository at this point in the history

  3. chore: fix typo in readme (PKU-Alignment#172)

    @rockmagma02
    rockmagma02 authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    9ffdb0e View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2023

  1. fix flake8

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    cd79584 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'PKU-MARL:dev' into dev

    @muchvo
    muchvo authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    c8796dc View commit details
    Browse the repository at this point in the history

  3. recover files

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    ba1b330 View commit details
    Browse the repository at this point in the history

  4. fix isort

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    0c0aef0 View commit details
    Browse the repository at this point in the history

  5. fix: fix autoreset wrapper (PKU-Alignment#167)

    @r-y1
    r-y1 authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    68b9be8 View commit details
    Browse the repository at this point in the history

  6. recover files

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    21cda5b View commit details
    Browse the repository at this point in the history

  7. Merge branch 'PKU-MARL:dev' into dev

    @muchvo
    muchvo authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    16e60b6 View commit details
    Browse the repository at this point in the history

  8. rebase dev

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    d321721 View commit details
    Browse the repository at this point in the history

  9. add warning for num_pool

    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    9173cdc View commit details
    Browse the repository at this point in the history

  10. fix: [pre-commit.ci] auto fixes [...]

    @pre-commit-ci
    pre-commit-ci[bot] committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    568b081 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'support_statistics_tools' of https://github.com/muchvo/… 

    …omnisafe into support_statistics_tools
    @muchvo
    muchvo committed Mar 26, 2023
    Configuration menu
    Copy the full SHA
    5d62c99 View commit details
    Browse the repository at this point in the history

  12. refactor(wrapper): refactor the cuda setting (PKU-Alignment#176) 

    * refactor(wrapper): refactor the cuda setting

* chore: revert train_policy.py

* chore: set device in safety_gymnasium_env.py

* fix: [pre-commit.ci] auto fixes [...]

* fix(safety_gymnasium_env.py): fix device interface

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @Gaiejj @pre-commit-ci
    Gaiejj and pre-commit-ci[bot] authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    8628ca6 View commit details
    Browse the repository at this point in the history

  13. docs: update README and the usage of CLI (PKU-Alignment#138) 

    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @zmsn-2077 @pre-commit-ci
    zmsn-2077 and pre-commit-ci[bot] authored Mar 26, 2023
    Configuration menu
    Copy the full SHA
    d077842 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. Merge branch 'dev' into support_statistics_tools

    @friedmainfunction
    friedmainfunction authored Mar 27, 2023
    Configuration menu
    Copy the full SHA
    f423941 View commit details
    Browse the repository at this point in the history

  2. update readme

    @muchvo
    muchvo committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    57b957d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev' of https://github.com/muchvo/omnisafe into support… 

    …_statistics_tools
    @muchvo
    muchvo committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    87f8796 View commit details
    Browse the repository at this point in the history

  4. fix typo

    @muchvo
    muchvo committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    6cfa4f2 View commit details
    Browse the repository at this point in the history