Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Skip redis raycluster sample YAML test #1465

Merged

Conversation

architkulkarni
Copy link
Contributor

Why are these changes needed?

My understanding is that the RayCluster sample YAML test framework only adds RayCluster CRs, but doesn't add the other resources in the sample YAML file (for example the external redis deployment). In the case of the external redis sample YAML, the sample YAML test started failing after #1412 and my tentative hypothesis is that the cleanup job added by the PR hangs if there's no external redis.

For now, we should merge this PR to unbreak CI. Later, we can decide whether to properly support an end-to-end external redis test.

Related issue number

Closes #1459

Checks

  • I've made sure the tests are passing.
  • Testing Strategy
    • Unit tests
    • Manual tests
    • This PR is not tested :(

Signed-off-by: Archit Kulkarni <[email protected]>
Copy link
Member

@kevin85421 kevin85421 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch! It makes sense. The issue arises because we deleted all Kubernetes objects defined in the YAML file, including Redis. Consequently, the Kubernetes cleanup job failed to clear the Redis cache successfully, preventing the removal of the finalizer. We may keep the issue opening until we fix the test.

[Update]
We can close the issue @rueian will take the rest.

@architkulkarni
Copy link
Contributor Author

Thanks for finding the actual root cause!

@architkulkarni architkulkarni merged commit 84c35ac into ray-project:master Oct 2, 2023
21 of 22 checks passed
rueian added a commit to rueian/kuberay that referenced this pull request Oct 13, 2023
kevin85421 pushed a commit to kevin85421/kuberay that referenced this pull request Oct 17, 2023
My understanding is that the RayCluster sample YAML test framework only adds RayCluster CRs, but doesn't add the other resources in the sample YAML file (for example the external redis deployment). In the case of the external redis sample YAML, the sample YAML test started failing after ray-project#1412 and my tentative hypothesis is that the cleanup job added by the PR hangs if there's no external redis.

For now, we should merge this PR to unbreak CI. Later, we can decide whether to properly support an end-to-end external redis test.

Related issue number
Closes ray-project#1459

Signed-off-by: Archit Kulkarni <[email protected]>
kevin85421 pushed a commit to kevin85421/kuberay that referenced this pull request Oct 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI][Buildkite] Test RayCluster sample YAMLs (nightly operator) is stuck indefinitely
2 participants