Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Katib ROADMAP 2022/2023 #2153

Merged
merged 4 commits into from
Aug 24, 2023
Merged

Add Katib ROADMAP 2022/2023 #2153

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
12042ef
Add Katib ROADMAP 2022/2023
andreyvelich May 10, 2023
a969bf4
Add multi-objective optimization
andreyvelich May 10, 2023
5e49dc3
Add Scalability Improvements
andreyvelich May 24, 2023
6357e37
Remove Katib CRD naming
andreyvelich Aug 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 42 additions & 2 deletions ROADMAP.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,45 @@
# Katib 2022/2023 Roadmap

## AutoML Features

- Support advance HyperParameter tuning algorithms:

- Population Based Training (PBT) - [#1382](https://github.com/kubeflow/katib/issues/1382)
- Tree of Parzen Estimators (TPE)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIUC, we already supported the TPE a long time ago, right?

https://github.com/kubeflow/katib/blob/279f6794dc6e71c5efedf4ef997d6346f60fe833/examples/v1beta1/hp-tuning/tpe.yaml

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's right @tenzen-y.
Since this ROADMAP for 2022/2023, I tried to outline features that we already implemented in 2022 there, so users will have overview of what we do in 2022-2023.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I see.
That's great! Thanks for clarifying!

- Multivariate TPE
- Sobol’s Quasirandom Sequence
- Asynchronous Successive Halving - [ASHA](https://arxiv.org/pdf/1810.05934.pdf)

- Support multi-objective optimization - [#1549](https://github.com/kubeflow/katib/issues/1549)
- Support various HP distributions (log-uniform, uniform, normal) - [#1207](https://github.com/kubeflow/katib/issues/1207)
- Support Auto Model Compression - [#460](https://github.com/kubeflow/katib/issues/460)
- Support Auto Feature Engineering - [#475](https://github.com/kubeflow/katib/issues/475)
- Improve Neural Architecture Search design

## Backend and API Enhancements

- Conformance tests for Katib - [#2044](https://github.com/kubeflow/katib/issues/2044)
- Support push-based metrics collection in Katib - [#577](https://github.com/kubeflow/katib/issues/577)
- Support PostgreSQL as a Katib DB - [#915](https://github.com/kubeflow/katib/issues/915)
- Improve Katib scalability - [#1847](https://github.com/kubeflow/katib/issues/1847)
- Promote Katib APIs to the `v1` version
- Support multiple CRD versions (`v1beta1`, `v1`) with conversion webhook

## Improve Katib User Experience

- Simplify Katib Experiment creation with Katib SDK - [#1951](https://github.com/kubeflow/katib/pull/1951)
- Fully migrate to a new Katib UI - [Project 1](https://github.com/kubeflow/katib/projects/1)
- Expose Trial logs in Katib UI - [#971](https://github.com/kubeflow/katib/issues/971)
- Enhance Katib UI visualization metrics for AutoML Experiments
- Improve Katib Config UX - [#2150](https://github.com/kubeflow/katib/issues/2150)

## Integration with Kubeflow Components

- Kubeflow Pipeline as a Katib Trial target - [#1914](https://github.com/kubeflow/katib/issues/1914)
- Improve data passing when Katib Experiment is part of Kubeflow Pipeline - [#1846](https://github.com/kubeflow/katib/issues/1846)

# History

# Katib 2021 Roadmap

## New Features
Expand All @@ -24,8 +66,6 @@
- Support multiple CRD version with conversion webhook
- MLMD integration with Katib Experiments

# History

# Katib 2020 Roadmap

## New Features
Expand Down