Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support batch suggest in SVC backend #667

Closed
osma opened this issue Feb 3, 2023 · 0 comments · Fixed by #670
Closed

Support batch suggest in SVC backend #667

osma opened this issue Feb 3, 2023 · 0 comments · Fixed by #670
Milestone

Comments

@osma
Copy link
Member

osma commented Feb 3, 2023

PR #663 is going to bring support for batch suggest operations.

The SVC backend could benefit from implementing _suggest_batch instead of _suggest. It could process a batch of texts with parallel and/or vector operations.

@osma osma added this to the Short term milestone Feb 3, 2023
@osma osma closed this as completed in #670 Feb 6, 2023
@osma osma modified the milestones: Short term, 0.61 Mar 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant