Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add shared search executor #2312

Merged
merged 1 commit into from
Feb 5, 2024

Conversation

MochiXu
Copy link
Contributor

@MochiXu MochiXu commented Feb 5, 2024

The approach to integrating Tantivy with ClickHouse is as follows:
A ClickHouse Table will have multiple DataParts, each with its own Tantivy index. However, I would like ClickHouse to share a thread pool among different DataParts during concurrent searches, in order to reduce resource overhead during the search process. I have created a bridging repo(tantivy-search) between Tantivy and ClickHouse.

The code for using a shared thread pool can be referred to at this link.

@fulmicoton fulmicoton merged commit 88a3275 into quickwit-oss:main Feb 5, 2024
2 of 3 checks passed
@fulmicoton
Copy link
Collaborator

Merged! Just to put it in your radar, Quickwit can be used to search into Clickhouse.

PSeitz pushed a commit that referenced this pull request Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants