Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

optimized parallelization: annotate sequence batches #322

Merged
merged 10 commits into from
May 30, 2021
Merged

optimized parallelization: annotate sequence batches #322

merged 10 commits into from
May 30, 2021

Conversation

karasikov
Copy link
Member

@karasikov karasikov commented May 23, 2021 •
edited
Loading

  • accumulate batches before annotating to reduce the overhead in the thread pool
  • add_label_counts is now thread-safe
  • added annotate_sequences for efficiently annotating batches in parallel
  • streamlined ColumnMajor

@karasikov karasikov requested a review from hmusta May 23, 2021 15:55
hmusta
hmusta approved these changes May 25, 2021
View reviewed changes
metagraph/src/cli/annotate.cpp Show resolved Hide resolved
metagraph/src/graph/annotated_dbg.cpp Show resolved Hide resolved
@karasikov karasikov merged commit 42ca47d into dev May 30, 2021
@karasikov karasikov deleted the mk/ann_batch branch May 30, 2021 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hmusta hmusta hmusta approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@karasikov @hmusta