Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch processing on label_mentions is not working #116

Open
coolcoder001 opened this issue Jun 17, 2022 · 1 comment
Open

Batch processing on label_mentions is not working #116

coolcoder001 opened this issue Jun 17, 2022 · 1 comment

Comments

@coolcoder001
Copy link

coolcoder001 commented Jun 17, 2022

Hi @lorr1 ,

Is it possible to have batch processing for label_mentions method? Currently it is taking a list of sentences, but internally in the code, I can see it is processing one sentence at a time. Is it possible to do this batchwise to speed up the process?

@lorr1
Copy link
Contributor

lorr1 commented Jun 18, 2022

Hey. It would be possible for sure. Setting up some worker queue for the processing.

It's not on my immediate roadmap to solve (as we have offline extract_mentions and dump_preds methods for batch processing). They are in our end2end tutorial.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants