-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cross-back-end process graph processing #150
Comments
@JeroenVerstraelen can you point me to the details on this feasibility study? |
soxofaan
added a commit
that referenced
this issue
Sep 13, 2024
soxofaan
added a commit
that referenced
this issue
Sep 13, 2024
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
decouple "load_collection" detection from subjob creation loop
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
… yielding Introduce ProcessGraphSplitterInterface, with first LoadCollectionGraphSplitter implementation based on existing simple graph splitting logic
soxofaan
added a commit
that referenced
this issue
Sep 16, 2024
soxofaan
added a commit
that referenced
this issue
Sep 17, 2024
soxofaan
added a commit
that referenced
this issue
Sep 17, 2024
decouple "load_collection" detection from subjob creation loop
soxofaan
added a commit
that referenced
this issue
Sep 17, 2024
… yielding Introduce ProcessGraphSplitterInterface, with first LoadCollectionGraphSplitter implementation based on existing simple graph splitting logic
soxofaan
added a commit
that referenced
this issue
Sep 17, 2024
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
also make graph walking more deterministic (e.g. to simplify test asserts)
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
Instead of dictionary Also move type coercion logic to _FrozenNode __init__ to eliminate boilerplate code
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
also add consistency check of _GraphViewer node map
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
soxofaan
added a commit
that referenced
this issue
Sep 18, 2024
soxofaan
added a commit
that referenced
this issue
Sep 19, 2024
soxofaan
added a commit
that referenced
this issue
Sep 19, 2024
…orBatchJobs._create_crossbackend_job
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
decouple "load_collection" detection from subjob creation loop
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
… yielding Introduce ProcessGraphSplitterInterface, with first LoadCollectionGraphSplitter implementation based on existing simple graph splitting logic
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
also make graph walking more deterministic (e.g. to simplify test asserts)
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
Instead of dictionary Also move type coercion logic to _FrozenNode __init__ to eliminate boilerplate code
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
also add consistency check of _GraphViewer node map
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
soxofaan
added a commit
that referenced
this issue
Sep 20, 2024
There are still some todo's and plenty of idea's for future work, but I decided to merge the current PoC with 9b65520 |
As discussed in #156 the idea is currently to trigger this feature with a job option like
|
Follow up todo's and tasks (WIP) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Follow up on #95 and #53. Develop a cross-back end process graph splitting implementation that is useful in the current aggregator setup. It should be based on the algorithm developed during the feasibility study.
The text was updated successfully, but these errors were encountered: