Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] Move connectors creation code to single point in RolloutWorker #29064

Merged
merged 6 commits into from
Oct 12, 2022

Conversation

ArturNiederfahrenhorst
Copy link
Contributor

Signed-off-by: Artur Niederfahrenhorst [email protected]

Why are these changes needed?

My first connectors/filters PR had two spots to have connectors, where there should be only one ideally.

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Signed-off-by: Artur Niederfahrenhorst <[email protected]>
Signed-off-by: Artur Niederfahrenhorst <[email protected]>
@ArturNiederfahrenhorst ArturNiederfahrenhorst changed the title [RLlib] Move connectors creation code to single point [RLlib] Move connectors creation code to single point in RolloutWorker Oct 5, 2022
Copy link
Member

@gjoliver gjoliver left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, that's right!! this is awesome!!
thanks.

@gjoliver
Copy link
Member

gjoliver commented Oct 5, 2022

can you take a look at the failed tests? test_rollout_worker looks suspicious.

@ArturNiederfahrenhorst
Copy link
Contributor Author

test_rollout_worker was marked as flakey and according to https://flakey-tests.ray.io/ has already been flakey. I can't reproduce an error on my side.

Signed-off-by: Artur Niederfahrenhorst <[email protected]>
Signed-off-by: Artur Niederfahrenhorst <[email protected]>
@c21 c21 added the Ray 2.1 label Oct 7, 2022
krfricke added a commit that referenced this pull request Oct 7, 2022
…29185)

Some PRs (e.g. #29064) only change a single file but trigger the full test suite. The reason is likely that we have a stale master head ref. By fetching the latest head, we should be able to see more accurate results here and avoid running too many tests.

Signed-off-by: Kai Fricke <[email protected]>
@c21
Copy link
Contributor

c21 commented Oct 8, 2022

Can it be merged? What's the remaing work here?

@ArturNiederfahrenhorst
Copy link
Contributor Author

No, thank you. Not a pressing change.

@c21
Copy link
Contributor

c21 commented Oct 8, 2022

Cool, removed as a blocker for branch cut.

@c21 c21 removed the Ray 2.1 label Oct 8, 2022
@@ -1905,9 +1868,24 @@ def _build_policy_map(
merged_conf,
)

if connectors_enabled and name in self.policy_map:
create_connectors_for_policy(self.policy_map[name], policy_config)
new_policy = self.policy_map[name]
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

_build_policy_map is called in add_policy and in init.

@gjoliver gjoliver merged commit 34cd1cb into ray-project:master Oct 12, 2022
WeichenXu123 pushed a commit to WeichenXu123/ray that referenced this pull request Dec 19, 2022
…ay-project#29185)

Some PRs (e.g. ray-project#29064) only change a single file but trigger the full test suite. The reason is likely that we have a stale master head ref. By fetching the latest head, we should be able to see more accurate results here and avoid running too many tests.

Signed-off-by: Kai Fricke <[email protected]>
Signed-off-by: Weichen Xu <[email protected]>
WeichenXu123 pushed a commit to WeichenXu123/ray that referenced this pull request Dec 19, 2022
@ArturNiederfahrenhorst ArturNiederfahrenhorst deleted the createconnectors branch January 5, 2023 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants