Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] Algorithm/Policy checkpoint overhaul and Policy Model export (in native formats). #28166

Merged
merged 105 commits into from
Oct 6, 2022

Commits on Jun 8, 2022

  1. wip

    sven1977 committed Jun 8, 2022
    Configuration menu
    Copy the full SHA
    d026a99 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    # Conflicts:
    #	rllib/BUILD
    sven1977 committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    50b6d69 View commit details
    Browse the repository at this point in the history
  2. wip.

    sven1977 committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    74cc999 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f6de7cd View commit details
    Browse the repository at this point in the history
  4. wip.

    sven1977 committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    8a24cd8 View commit details
    Browse the repository at this point in the history
  5. wip.

    sven1977 committed Jun 9, 2022
    Configuration menu
    Copy the full SHA
    de46f48 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/examples/export/onnx_tf.py
    #	rllib/examples/export/onnx_torch.py
    #	rllib/policy/dynamic_tf_policy_v2.py
    #	rllib/policy/eager_tf_policy_v2.py
    #	rllib/policy/tests/test_policy.py
    #	rllib/policy/torch_policy_v2.py
    sven1977 committed Aug 28, 2022
    Configuration menu
    Copy the full SHA
    db5324d View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 29, 2022
    Configuration menu
    Copy the full SHA
    e5611c1 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    01a9e47 View commit details
    Browse the repository at this point in the history
  2. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    eed6218 View commit details
    Browse the repository at this point in the history
  3. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    69352dc View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    88ec1d6 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    f8c796e View commit details
    Browse the repository at this point in the history
  2. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    6ad1e80 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2022

  1. Configuration menu
    Copy the full SHA
    191550d View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Configuration menu
    Copy the full SHA
    52235db View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    5e44e2e View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    fb8e89b View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    49429bd View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    f5a5430 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2022

  1. Configuration menu
    Copy the full SHA
    41e9dd8 View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    5261c53 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    94399e1 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2022

  1. Configuration menu
    Copy the full SHA
    8ddba8b View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    799be4b View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    0117db2 View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    e3bdf70 View commit details
    Browse the repository at this point in the history
  5. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 9, 2022
    Configuration menu
    Copy the full SHA
    3071270 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2022

  1. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    82f5b41 View commit details
    Browse the repository at this point in the history
  2. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    81c7d30 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Configuration menu
    Copy the full SHA
    c044cae View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c898e18 View commit details
    Browse the repository at this point in the history
  3. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    08ba388 View commit details
    Browse the repository at this point in the history
  4. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    5f66ee9 View commit details
    Browse the repository at this point in the history
  5. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    1474621 View commit details
    Browse the repository at this point in the history
  6. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    3d91cd1 View commit details
    Browse the repository at this point in the history
  7. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    04b9e01 View commit details
    Browse the repository at this point in the history
  8. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    b7b3ebb View commit details
    Browse the repository at this point in the history
  9. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    6209017 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    113ccf8 View commit details
    Browse the repository at this point in the history
  2. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    6aa6f06 View commit details
    Browse the repository at this point in the history
  3. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0b54fbf View commit details
    Browse the repository at this point in the history
  4. wip.

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    d3d85d2 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    c0e2e8d View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into befo…

    …re_sub_env_reset_callback
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/algorithms/callbacks.py
    #	rllib/algorithms/tests/test_callbacks.py
    #	rllib/evaluation/env_runner_v2.py
    #	rllib/evaluation/sampler.py
    sven1977 committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    6fafcf4 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. Configuration menu
    Copy the full SHA
    70f2bdb View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    f69ed2a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5ffab1e View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    f0dfda9 View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    b31114c View commit details
    Browse the repository at this point in the history
  6. merge

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    8fde067 View commit details
    Browse the repository at this point in the history
  7. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    c8afcf3 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    2c250d7 View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    f230ffc View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into add_…

    …policy_takes_policy_instance
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    80b1829 View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    a01ccb2 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    447ba02 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9a80a90 View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    2c4754c View commit details
    Browse the repository at this point in the history
  6. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    8070201 View commit details
    Browse the repository at this point in the history
  7. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    51ff6ae View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    b72a192 View commit details
    Browse the repository at this point in the history
  9. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    bb8e7a0 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    9ad4aa7 View commit details
    Browse the repository at this point in the history
  11. Merge branch 'add_policy_takes_policy_instance' into model_export_ove…

    …rhaul
    
    # Conflicts:
    #	rllib/algorithms/algorithm.py
    #	rllib/connectors/util.py
    sven1977 committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    3b1bc8f View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    60b0e51 View commit details
    Browse the repository at this point in the history
  2. LINT

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    45f3792 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    73fd3d1 View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    cc61975 View commit details
    Browse the repository at this point in the history
  5. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/algorithms/algorithm.py
    #	rllib/evaluation/worker_set.py
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    a3bf614 View commit details
    Browse the repository at this point in the history
  6. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    1ad8e7a View commit details
    Browse the repository at this point in the history
  7. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    b6de057 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/tests/backward_compat/test_backward_compat.py
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    27083df View commit details
    Browse the repository at this point in the history
  2. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/tests/backward_compat/test_backward_compat.py
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    b396923 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    4c7a85c View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    4efb544 View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    35a1eb7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    11ee0f5 View commit details
    Browse the repository at this point in the history
  7. LINT

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    3f375b3 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2022

  1. Merge branch 'master' of https://github.com/ray-project/ray into mode…

    …l_export_overhaul
    
    Signed-off-by: sven1977 <[email protected]>
    
    # Conflicts:
    #	rllib/tests/backward_compat/test_backward_compat.py
    sven1977 committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    11c8212 View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 28, 2022
    Configuration menu
    Copy the full SHA
    2258378 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    ccca4e5 View commit details
    Browse the repository at this point in the history
  2. merge

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    c66d30b View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Sep 30, 2022
    Configuration menu
    Copy the full SHA
    d52cda3 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2022

  1. Configuration menu
    Copy the full SHA
    5f09214 View commit details
    Browse the repository at this point in the history
  2. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    5e03461 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    151b65d View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    5a652cf View commit details
    Browse the repository at this point in the history
  5. LINT

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    fd17683 View commit details
    Browse the repository at this point in the history
  6. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 4, 2022
    Configuration menu
    Copy the full SHA
    881c128 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    c099a55 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b3adcd2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    84e92d0 View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    926808d View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    bfe1a21 View commit details
    Browse the repository at this point in the history
  6. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    6fd673c View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    e80459a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    116e706 View commit details
    Browse the repository at this point in the history
  3. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    7b724fc View commit details
    Browse the repository at this point in the history
  4. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    1cfdf81 View commit details
    Browse the repository at this point in the history
  5. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    e27c0d1 View commit details
    Browse the repository at this point in the history
  6. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    2f53966 View commit details
    Browse the repository at this point in the history
  7. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    cef1d2a View commit details
    Browse the repository at this point in the history
  8. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    30c3dad View commit details
    Browse the repository at this point in the history
  9. wip

    Signed-off-by: sven1977 <[email protected]>
    sven1977 committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    9a18fcc View commit details
    Browse the repository at this point in the history