Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Operational] WAL Cleanup #2288

Closed
atroyn opened this issue Jun 5, 2024 · 1 comment
Closed

[Operational] WAL Cleanup #2288

atroyn opened this issue Jun 5, 2024 · 1 comment
Assignees
Labels
Local Chroma An improvement to Local (single node) Chroma

Comments

@atroyn
Copy link
Contributor

atroyn commented Jun 5, 2024

WAL Cleanup

The WAL grows unbounded, which can cause performance degradation on developer-class machines, especially on use-cases with dynamic data (which we are particularly focused on supporting): #2143

There are tools to clean this up but they shouldn’t be needed by default. Ideally the default developer should have no awareness of this at all.

API Design

TBA

[Complexity] Subtask

  • [Unknown] Integrate tooling to clean up the WAL by user triggering.
  • [Unknown] Automatically clean up the WAL with sensible defaults.
  • [Unknown] Clean up the WAL in a resource-aware way.
@atroyn atroyn added in-progress Currently working on this Local Chroma An improvement to Local (single node) Chroma labels Jun 5, 2024
@atroyn atroyn added this to the Local Chroma v.0.6 milestone Jun 5, 2024
@atroyn atroyn removed the in-progress Currently working on this label Jun 5, 2024
@codetheweb
Copy link
Contributor

Closed by the #2519 stack.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Local Chroma An improvement to Local (single node) Chroma
Projects
None yet
Development

No branches or pull requests

3 participants