Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: multiple bugs for mixed local-kubernetes pipelines #533

Merged
merged 1 commit into from
Nov 13, 2024

Conversation

starpit
Copy link
Member

@starpit starpit commented Nov 13, 2024

  • updates pipeline-demo.sh so that when it is running in kubernetes mode, it actually does a mix of local and kubernetes
  • updates pipeline-demo.sh to launch a separate minio, and fixed some issues with using it. this should give us some test coverage for a “remote/hosted” s3. it aws also necessary to support mixed kubernetes-local.
  • fixes a couple of bugs with run context (missing step) and with this mix-mode and with pipelines versus external/hosted s3
  • fixes a race condition in the workstealer caused by the use of the debouncer

@starpit starpit force-pushed the mix-fixes branch 11 times, most recently from 689a3fb to 68884f2 Compare November 13, 2024 22:26
- updates `pipeline-demo.sh` so that when it is running in kubernetes mode, it actually does a mix of local and kubernetes
- updates `pipeline-demo.sh` to launch a separate minio, and fixed some issues with using it. this should give us some test coverage for a “remote/hosted” s3. it aws also necessary to support mixed kubernetes-local.
- fixes a couple of bugs with run context (missing step) and with this mix-mode and with pipelines versus external/hosted s3
- fixes a race condition in the workstealer caused by the use of the debouncer

Signed-off-by: Nick Mitchell <[email protected]>
@starpit starpit merged commit 2f9fb17 into IBM:main Nov 13, 2024
21 checks passed
@starpit starpit deleted the mix-fixes branch November 13, 2024 23:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant