Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

6 scheduling #36

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

6 scheduling #36

wants to merge 8 commits into from

Commits on Nov 1, 2024

  1. extracted resource watching logic into a separate class; implemented …

    …logic for observer in a RecourceWatcher class; added method to stop a thread gracefully
    vlerkin committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    4c0a82d View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. add kubernetes scheduler class that subscribes to the event observer …

    …that handles the logic to unsuspend jobs and get the next in order according to the creation timestamp; modify schedule endpoint to start jobs suspended if there is already enogh jobs running; modify corresponding function in k8s launcher; add to k8s launcher methods to unsuspend job, to get current number of running jobs, to list suspended jobs and a private method to get job name to be used for unsuspend function
    vlerkin committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    da8254f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9dae80d View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. finish the observer logic extraction; merge changes from main; add re…

    …source watcher instance to enable_joblogs to subscribe to the event watcher if the log feature is configured; delete logic about event watcher from main; pass container for list objects function instead of container name; remove start methon from log handler class; modify joblogs init to subscribe to event watcher
    vlerkin committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    7f66895 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    963f279 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Configuration menu
    Copy the full SHA
    7dc24bc View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. add implementation for docker to check the number of running containe…

    …rs and run more from the queue of created jobs when capacity is available; add backgroung thread that sleeps for 5 sec and triggers the function that starts additional containers up to capacity; add a method to gracefully stop the background thread that might be used in the future to stop the thread when app stops; encapsulate k8s and docker related schedule functionality in corresponding launchers and keep api.py launcher agnostic; add max_proc to config for docker
    vlerkin committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    98f5559 View commit details
    Browse the repository at this point in the history
  2. remove update from RBAC because we perform patching of the resource a…

    …nd patch is sufficient
    vlerkin committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    01b120b View commit details
    Browse the repository at this point in the history