Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] [Connectors] Fix test multi agent sample sync remote connectors #30307

Conversation

avnishn
Copy link
Member

@avnishn avnishn commented Nov 15, 2022

Policy mapping function takes as a parameter episodes now

Why are these changes needed?

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

The agent collector wasn't adding rnn initial states
to training batches. This caused the initial states to be improperly affected,
which we know breaks test_lstm and test_multi_agent_env.

Signed-off-by: Avnish <[email protected]>
@avnishn avnishn force-pushed the fix_test_multi_agent_sample_sync_remote_connectors branch from 32c51cc to 9fca30d Compare November 16, 2022 01:02
avnishn and others added 11 commits November 15, 2022 20:57
The agent collector wasn't adding rnn initial states
to training batches. This caused the initial states to be improperly affected,
which we know breaks test_lstm and test_multi_agent_env.

Signed-off-by: Avnish <[email protected]>
Signed-off-by: Avnish <[email protected]>
Signed-off-by: Avnish <[email protected]>

Co-authored-by: Artur Niederfahrenhorst <[email protected]>
Signed-off-by: Artur Niederfahrenhorst <[email protected]>
…y-project#30316)

This shows the development workflow on how to incorporate API examples into the documentation and how to run doctests locally.
Signed-off-by: Avnish <[email protected]>
@avnishn avnishn force-pushed the fix_test_multi_agent_sample_sync_remote_connectors branch from 12f68fb to dc65f06 Compare November 16, 2022 05:24
@avnishn avnishn requested a review from a team as a code owner November 16, 2022 05:24
@avnishn avnishn closed this Nov 17, 2022
@avnishn avnishn reopened this Nov 17, 2022
@gjoliver
Copy link
Member

test failures are known. some of these are already fixed.

@gjoliver gjoliver merged commit e80eec9 into ray-project:master Nov 17, 2022
WeichenXu123 pushed a commit to WeichenXu123/ray that referenced this pull request Dec 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants