Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gce tests #33489

Merged
merged 7 commits into from
Mar 20, 2023
Merged

Gce tests #33489

merged 7 commits into from
Mar 20, 2023

Conversation

can-anyscale
Copy link
Collaborator

Why are these changes needed?

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

can-anyscale and others added 7 commits March 18, 2023 10:30
…s been creeping through many of ci/cd builds in our pipeline.

The existing code uses pipe to read from a rather large file (>50MB). Pipe however has buffer limit which by default in term of kb (https://man7.org/linux/man-pages/man7/pipe.7.html) so what we look for might not exist. We can fix this by tell unzip the exact file we are looking for. That file is pretty small so we should not hit buffer limit.

You might notice other surpises might still happen with this fix (e.g. many files that match ^__commit__). This sanity check goes back to 2 years ago by our veteran Kai (234b015) to sanity check issues with stale artifacts from previous builds or race conditions between builds. Further investigation on how builkite agent multi-tenant is setup might or might not simplify this logic further.

Signed-off-by: Cuong Nguyen <[email protected]>
Signed-off-by: Cuong Nguyen <[email protected]>
@can-anyscale can-anyscale merged commit ae72424 into ray-project:can-ci-testing Mar 20, 2023
@Yard1
Copy link
Member

Yard1 commented Mar 20, 2023

Hey @can-anyscale, did you mean to merge this without review? We should make sure to get review approval before merging, especially from code owners :)

@can-anyscale
Copy link
Collaborator Author

Hi @Yard1, yes this is intentionally, I pushed code change to the can-ci-testing branch and kick off a buildkite from that branch, a way for me to test CI changes. Let me know if this is not the right way to do it (create a branch and push code randomly to it).

@Yard1
Copy link
Member

Yard1 commented Mar 20, 2023

Ah, my bad, thought this was a PR to master! Yeah, this should be fine

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants