Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: InferenceService reconcile function #541

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

Al-Pragliola
Copy link
Contributor

Description

The InferenceService reconcile function is responsible for managing the lifecycle of Model Registry InferenceService entities, the prerequisite for an InferenceService to be associated with an MR entity is that the required labels "modelregistry.opendatahub.io/model-version-id" or "modelregistry.opendatahub.io/inference-service-id" are set, then the reconcile function will create (or get, if it already exists) a ServingEnvironment in the Model Registry whose name is the same as the namespace of the InferenceService. The reconcile function will also create (or get, if the label "modelregistry.opendatahub.io/inference-service-id" is set) an InferenceService in the Model Registry associated with the ServingEnvironment, the DesiredState will be "DEPLOYED", if the InferenceService is deleted, the reconcile function will set the DesiredState to "UNDEPLOYED".

How Has This Been Tested?

Merge criteria:

  • All the commits have been signed-off (To pass the DCO check)
  • The commits have meaningful messages; the author will squash them after approval or in case of manual merges will ask to merge with squash.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work.
  • Code changes follow the kubeflow contribution guidelines.

Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign tarilabs for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@Al-Pragliola Al-Pragliola force-pushed the feat/inferenceservice-controller branch from bf7166c to fee2381 Compare November 7, 2024 16:22
Signed-off-by: Alessio Pragliola <[email protected]>
@Al-Pragliola Al-Pragliola marked this pull request as ready for review November 7, 2024 20:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant