Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor: change architecture of omnisafe #121

Merged
merged 40 commits into from
Feb 23, 2023
Merged

refactor: change architecture of omnisafe #121

merged 40 commits into from
Feb 23, 2023

Commits on Feb 23, 2023

  1. fix(algo): policy_gradient adpat to new logger api

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    6a39f07 View commit details
    Browse the repository at this point in the history

  2. fix(algo): adapt all algo to new logger api

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    7c1e60d View commit details
    Browse the repository at this point in the history

  3. feat(config): support wandb

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    a05abae View commit details
    Browse the repository at this point in the history

  4. fix(algo): fix typo bugs

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    e048bf9 View commit details
    Browse the repository at this point in the history

  5. feat: Implement difference logging in logger

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    6284907 View commit details
    Browse the repository at this point in the history

  6. refactor: delete RecordQueue in PolicyGradient

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    75c3716 View commit details
    Browse the repository at this point in the history

  7. refactor: delete RecordQueie in algos

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    50b7ade View commit details
    Browse the repository at this point in the history

  8. refactor: delete record_queue

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    f848bae View commit details
    Browse the repository at this point in the history

  9. refactor(common): refactor normalizer

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    0460915 View commit details
    Browse the repository at this point in the history

  10. refactor(utils): refactor distributed

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    ccb65a9 View commit details
    Browse the repository at this point in the history

  11. refactor(utils): refactor model

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    bbab76e View commit details
    Browse the repository at this point in the history

  12. refactor(utils): refactor model utils

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    cb81043 View commit details
    Browse the repository at this point in the history

  13. refactor(common): move vtrace to buffer

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    b890c97 View commit details
    Browse the repository at this point in the history

  14. refactor(utils): move set_optimizer to model

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    4d6cf19 View commit details
    Browse the repository at this point in the history

  15. refactor: refactor function in utils

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    5dce77c View commit details
    Browse the repository at this point in the history

  16. feat(env): support different envs via class CMDP

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    0a7cce9 View commit details
    Browse the repository at this point in the history

  17. feat(env): add wrapper

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    637f70b View commit details
    Browse the repository at this point in the history

  18. feat(adapter): online and onpolicy adapter

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    03306d7 View commit details
    Browse the repository at this point in the history

  19. refactor(algo) : policy gradient

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    d6c67be View commit details
    Browse the repository at this point in the history

  20. feat(utils): add function seed_all

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    62fea3a View commit details
    Browse the repository at this point in the history

  21. fix(algo): policy gradient bug

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    abffcfa View commit details
    Browse the repository at this point in the history

  22. fix(adapter): fix wrong ep_len

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    b08706e View commit details
    Browse the repository at this point in the history

  23. fix(algo):

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    849ae0d View commit details
    Browse the repository at this point in the history

  24. feat(algo): adapte olf pg to new env

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    7ba9dcd View commit details
    Browse the repository at this point in the history

  25. fix(algo) policy gradient bugs

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    c0d0003 View commit details
    Browse the repository at this point in the history

  26. fix(algo): old pg

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    5cfe131 View commit details
    Browse the repository at this point in the history

  27. style(envs): wrapper code style

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    a45fcc6 View commit details
    Browse the repository at this point in the history

  28. refactor(model)

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    938dbce View commit details
    Browse the repository at this point in the history

  29. refactor(config): depend ModelConfig

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    c469e9f View commit details
    Browse the repository at this point in the history

  30. feat(utils): add Tanh distrribution

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    cdbbd9c View commit details
    Browse the repository at this point in the history

  31. feat(utils): add schedlue

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    eba9c31 View commit details
    Browse the repository at this point in the history

  32. refactor(normalize): support parller online mean

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    2636c52 View commit details
    Browse the repository at this point in the history

  33. refactor(env): adapt wrapper to new normailze

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    3279282 View commit details
    Browse the repository at this point in the history

  34. refactor(model): adapt net actor api

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    99e3566 View commit details
    Browse the repository at this point in the history

  35. refactor(config)

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    b2b4807 View commit details
    Browse the repository at this point in the history

  36. refactor(algo)

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    7de64ec View commit details
    Browse the repository at this point in the history

  37. refactor: pass mypy

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    2cb53ac View commit details
    Browse the repository at this point in the history

  38. chore: activate mypy test in ci

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    0d071de View commit details
    Browse the repository at this point in the history

  39. refactor(test): delete test_utils

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    596dced View commit details
    Browse the repository at this point in the history

  40. build: add types-pyyaml

    @rockmagma02
    rockmagma02 committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    e438a0f View commit details
    Browse the repository at this point in the history