Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Add GCE variances to Data tests #34105

Merged
merged 35 commits into from
Apr 17, 2023
Merged

Conversation

bveeramani
Copy link
Member

@bveeramani bveeramani commented Apr 5, 2023

Why are these changes needed?

This PR configures BuildKite to run Data release tests on GCE. I excluded the parquet_metadata_resolution and shuffle_data_loader release tests because more work is required to migrate those tests.

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

bveeramani and others added 27 commits November 21, 2022 21:00
Signed-off-by: Balaji Veeramani <[email protected]>
This reverts commit de05655.

Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Balaji Veeramani <[email protected]>

head_node_type:
name: head_node
instance_type: n1-standard-64-nvidia-tesla-t4-1
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We actually don't have this type of machine, the list is here: https://github.com/anyscale/product/blob/master/backend/utils/allowed_gpus.yaml

@can-anyscale
Copy link
Collaborator

If you can scan through the list of failing tests real quick and see if there are any obvious such as a wrong type of machines, that would be great.

If the error is not comprehensible then you can merge the PR.

Signed-off-by: Balaji Veeramani <[email protected]>
@amogkam
Copy link
Contributor

amogkam commented Apr 17, 2023

are the failing tests ok?

@bveeramani
Copy link
Member Author

@amogkam yeah. Discussed with @can-anyscale and we're going to merge the PR with the failing tests.

@can-anyscale
Copy link
Collaborator

Hi yes, please merge even if they fail if the failures are not comprehensible or infra failure related. They are running on GCE stack for the first time so we expect some of them to fail. Merge into master will help the infra team to look at them easier. Thankks

@amogkam
Copy link
Contributor

amogkam commented Apr 17, 2023

ok can you add a pr description please?

@amogkam amogkam merged commit 8af7814 into ray-project:master Apr 17, 2023
elliottower pushed a commit to elliottower/ray that referenced this pull request Apr 22, 2023
This PR configures BuildKite to run Data release tests on GCE. I excluded the parquet_metadata_resolution and shuffle_data_loader release tests because more work is required to migrate those tests.

---------

Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: elliottower <[email protected]>
amogkam pushed a commit that referenced this pull request Apr 24, 2023
This PR configures BuildKite to run the shuffle_data_loader Data release tests on GCE. This test was previously excluded in #34105.

---------

Signed-off-by: Balaji Veeramani <[email protected]>
ProjectsByJackHe pushed a commit to ProjectsByJackHe/ray that referenced this pull request May 4, 2023
This PR configures BuildKite to run Data release tests on GCE. I excluded the parquet_metadata_resolution and shuffle_data_loader release tests because more work is required to migrate those tests.

---------

Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Jack He <[email protected]>
ProjectsByJackHe pushed a commit to ProjectsByJackHe/ray that referenced this pull request May 4, 2023
This PR configures BuildKite to run the shuffle_data_loader Data release tests on GCE. This test was previously excluded in ray-project#34105.

---------

Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: Jack He <[email protected]>
architkulkarni pushed a commit to architkulkarni/ray that referenced this pull request May 16, 2023
This PR configures BuildKite to run the shuffle_data_loader Data release tests on GCE. This test was previously excluded in ray-project#34105.

---------

Signed-off-by: Balaji Veeramani <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants