Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement]: Improve compaction performance #37234

Open
1 task done
tedxu opened this issue Oct 29, 2024 · 0 comments
Open
1 task done

[Enhancement]: Improve compaction performance #37234

tedxu opened this issue Oct 29, 2024 · 0 comments
Labels
kind/enhancement Issues or changes related to enhancement

Comments

@tedxu
Copy link
Contributor

tedxu commented Oct 29, 2024

Is there an existing issue for this?

  • I have searched the existing issues

What would you like to be added?

Compaction operations are essential for maintaining the overall stability and performance of the system. Although stability has been significantly improved through memory control, as seen in issues like #30682 and #32612, performance concerns may persist. For instance, typical L0 and mixed compaction processes can take anywhere from minutes to hours to complete.

To address this, I suggest implementing benchmarks and profiling to assess the current state. Based on these findings, we can develop targeted fixes to enhance the performance of compaction operations.

Why is this needed?

No response

Anything else?

No response

@tedxu tedxu added the kind/enhancement Issues or changes related to enhancement label Oct 29, 2024
sre-ci-robot pushed a commit that referenced this issue Oct 29, 2024
tedxu added a commit to tedxu/milvus that referenced this issue Oct 29, 2024
tedxu added a commit that referenced this issue Oct 29, 2024
sre-ci-robot pushed a commit that referenced this issue Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement Issues or changes related to enhancement
Projects
None yet
Development

No branches or pull requests

1 participant