Skip to content

Commit

Permalink
[Data] Repurpose streaming CI to bulk CI(ray-project#33478)
Browse files Browse the repository at this point in the history
Streaming executor is enabled by default. We repurpose this streaming CI to bulk so we can get some coverage of bulk (at least for now).

Signed-off-by: elliottower <[email protected]>
  • Loading branch information
jianoaix authored and elliottower committed Apr 22, 2023
1 parent 2904397 commit 20b3761
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions .buildkite/pipeline.ml.yml
Original file line number Diff line number Diff line change
Expand Up @@ -433,16 +433,16 @@
- sudo service mongodb stop
- sudo apt-get purge -y mongodb*

- label: "Dataset tests (streaming executor)"
- label: "Dataset tests (bulk executor)"
conditions: ["NO_WHEELS_REQUIRED", "RAY_CI_DATA_AFFECTED"]
instance_size: medium
commands:
- cleanup() { if [ "${BUILDKITE_PULL_REQUEST}" = "false" ]; then ./ci/build/upload_build_info.sh; fi }; trap cleanup EXIT
- ./ci/env/install-java.sh
- DATA_PROCESSING_TESTING=1 ARROW_VERSION=7.* ./ci/env/install-dependencies.sh
- ./ci/env/env_info.sh
- bazel test --config=ci $(./ci/run/bazel_export_options) --action_env=RAY_DATASET_USE_STREAMING_EXECUTOR=1 --build_tests_only --test_tag_filters=-dataset_integration python/ray/data/...
- bazel test --config=ci $(./ci/run/bazel_export_options) --action_env=RAY_DATASET_USE_STREAMING_EXECUTOR=1 --build_tests_only --test_tag_filters=ray_data python/ray/air/...
- bazel test --config=ci $(./ci/run/bazel_export_options) --action_env=RAY_DATASET_USE_STREAMING_EXECUTOR=0 --build_tests_only --test_tag_filters=-dataset_integration python/ray/data/...
- bazel test --config=ci $(./ci/run/bazel_export_options) --action_env=RAY_DATASET_USE_STREAMING_EXECUTOR=0 --build_tests_only --test_tag_filters=ray_data python/ray/air/...

- label: "Dataset tests (Arrow nightly)"
conditions: ["NO_WHEELS_REQUIRED", "RAY_CI_PYTHON_AFFECTED", "RAY_CI_DATA_AFFECTED"]
Expand Down

0 comments on commit 20b3761

Please sign in to comment.