Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Run sample job YAML tests in buildkite #1315

Merged

Conversation

architkulkarni
Copy link
Contributor

Why are these changes needed?

Sets up the Buildkite CI pipeline to test the RayJob sample YAML files using kind.

Related issue number

Closes #1246

Checks

  • I've made sure the tests are passing.
  • Testing Strategy
    • Unit tests
    • Manual tests
    • This PR is not tested :(

Signed-off-by: Archit Kulkarni <[email protected]>
tests/framework/config/kind-config-buildkite.yml Outdated Show resolved Hide resolved
DEFAULT_KIND_CONFIG = REPO_ROOT.joinpath("tests/framework/config/kind-config.yaml")

# Decide the config based on the environment
if os.getenv("BUILDKITE_ENV", default="") == "true":
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need a new kind config?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new part of the config is copied from https://github.com/ray-project/ray/pull/22035/files#diff-cbbac00da1880527c8b203aeb03a1d3c492610ee1fc97f868392589c5b831893. I'm not sure about the technical details here, but it's necessary to get kubectl to work in buildkite.

I'm not sure if it has any ill effects for users who want to run the test locally, so to be safe I just made another config file.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it. We can figure this out in the future.

Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Signed-off-by: Archit Kulkarni <[email protected]>
Copy link
Member

@kevin85421 kevin85421 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@architkulkarni
Copy link
Contributor Author

Not working yet so I'll mark as draft

@architkulkarni architkulkarni marked this pull request as draft August 10, 2023 23:52
@architkulkarni architkulkarni marked this pull request as ready for review August 11, 2023 18:37
@architkulkarni
Copy link
Contributor Author

The Buildkite sample rayjob YAML test passed and the test logs are as expected: https://buildkite.com/ray-project/ray-ecosystem-ci-kuberay-ci/builds/1249#0189e5e3-9193-4717-8edd-c8c1bdc7ea3a/237-2560

@architkulkarni architkulkarni merged commit df7cfe1 into ray-project:master Aug 11, 2023
18 checks passed
@architkulkarni architkulkarni deleted the test-rayjob-sample-yamls branch August 11, 2023 19:27
blublinsky pushed a commit to blublinsky/kuberay that referenced this pull request Aug 15, 2023
Sets up the Buildkite CI pipeline to test the RayJob sample YAML files using kind.

Related issue number
Closes ray-project#1246

---------

Signed-off-by: Archit Kulkarni <[email protected]>
blublinsky pushed a commit to blublinsky/kuberay that referenced this pull request Aug 15, 2023
Sets up the Buildkite CI pipeline to test the RayJob sample YAML files using kind.

Related issue number
Closes ray-project#1246

---------

Signed-off-by: Archit Kulkarni <[email protected]>
lowang-bh pushed a commit to lowang-bh/kuberay that referenced this pull request Sep 24, 2023
Sets up the Buildkite CI pipeline to test the RayJob sample YAML files using kind.

Related issue number
Closes ray-project#1246

---------

Signed-off-by: Archit Kulkarni <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants