Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

EJR: make ZooKeeper code path optional #498

Closed
soxofaan opened this issue Aug 30, 2023 · 1 comment
Closed

EJR: make ZooKeeper code path optional #498

soxofaan opened this issue Aug 30, 2023 · 1 comment
Assignees
@soxofaan
Labels
architecture technical debt

Comments

@soxofaan
Copy link
Member

Already started implementing, but figured to track it with separate ticket (related to #236):
make the ZooKeeper part of DoubleJobRegistry optional, e.g. so that it can be disabled
soxofaan added a commit that referenced this issue Aug 30, 2023
@soxofaan
Issue #236/#498 optional ZK handling in DoubleJobRegistry.delete
903c755
soxofaan added a commit that referenced this issue Aug 30, 2023
@soxofaan
Issue #236/#498 optional ZK handling for set_dependencies/remove_depe…
1a5862d 
…ndencies
soxofaan added a commit that referenced this issue Aug 30, 2023
@soxofaan
Issue #236/#498 optional ZK handling for mark_ongoing
0efcc42
soxofaan added a commit that referenced this issue Aug 30, 2023
@soxofaan
Issue #236/#498 more optional ZK handling
82d1ee3 
set_dependency_status, set_dependency_usage, set_proxy_user, set_application_id
@soxofaan soxofaan changed the title EJR: make ZooKeeper code path optionsl EJR: make ZooKeeper code path optional Aug 30, 2023
soxofaan added a commit that referenced this issue Aug 30, 2023
@soxofaan
Issue #236/#498 make zk_job_registry_factory optional in DoubleJobReg…
3020dd2 
…istry
soxofaan added a commit that referenced this issue Sep 12, 2023
@soxofaan
Issue #236/#498 transfer some todo notes to newer ticket #498
4a863b5
@soxofaan soxofaan mentioned this issue Sep 12, 2023
Closed
@soxofaan soxofaan mentioned this issue Sep 29, 2023
Closed
soxofaan added a commit that referenced this issue Sep 29, 2023
@soxofaan
Issue #523/#498/#236 Fall back on EJR when no job metadata in ZK
9a89505
@soxofaan soxofaan mentioned this issue Sep 29, 2023
Closed
soxofaan added a commit that referenced this issue Dec 6, 2023
@soxofaan
make GpsBatchJobs._start_job compatible with EJR based job info
70bd2c4 
refs: #498 #236 #531
@soxofaan soxofaan mentioned this issue Jan 4, 2024
Closed
soxofaan added a commit that referenced this issue Jan 4, 2024
@soxofaan
Add use_zk_job_registry config to optionally disable `ZkJobRegistry…
5475236 
…` usage #236/#498/#632
soxofaan added a commit that referenced this issue May 17, 2024
@soxofaan
Align job registry implementations: omit process/job_options from get…
a632e1a 
…_user_jobs listings

Process graph (and job options) are not to be included in user job listings,
so align `ZkJobRegistry.get_user_jobs` to not produce then like `ElasticJobRegistry`

refs: eu-cdse/openeo-cdse-infra#141, #498
@soxofaan soxofaan self-assigned this May 17, 2024
soxofaan added a commit that referenced this issue May 17, 2024
@soxofaan
Align job registry implementations: omit process/job_options from get…
10bf582 
…_user_jobs listings

Process graph (and job options) are not to be included in user job listings,
so align `ZkJobRegistry.get_user_jobs` to not produce then like `ElasticJobRegistry`

refs: eu-cdse/openeo-cdse-infra#141, #498
soxofaan added a commit that referenced this issue May 17, 2024
@soxofaan
Also align job registry get_job implementations better
b5fe1e8 
refs: eu-cdse/openeo-cdse-infra#141, #498
soxofaan added a commit that referenced this issue May 17, 2024
@soxofaan
Add zk_job_registry_max_specification_size config to set limit on Z…
061090e 
…kJobRegistry process graph size

to avoid slamming zookeeper with entries that are excessively large

refs: eu-cdse/openeo-cdse-infra#141, #498
soxofaan added a commit that referenced this issue May 18, 2024
@soxofaan
Add zk_job_registry_max_specification_size config to set limit on Z…
0c2b161 
…kJobRegistry process graph size

to avoid slamming zookeeper with entries that are excessively large

refs: eu-cdse/openeo-cdse-infra#141, #498
@soxofaan
Copy link
Member Author

As discussed, I think it's best to consider this ticket to be closed and continue work in follow up tickets like eu-cdse/openeo-cdse-infra#141

@soxofaan soxofaan mentioned this issue Sep 12, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@soxofaan soxofaan

Labels
architecture technical debt
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@soxofaan