Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Default memory allocations for bwa index step are too low for igenomes #379

Closed
lfearnley opened this issue Jul 18, 2023 · 4 comments
Closed
Labels
bug Something isn't working
Milestone

Comments

@lfearnley
Copy link

Description of the bug

bwa-mem2 index module is tagged with 'process_single'; and is allocated only 6GB of memory as a result. If you run nf-raredisease on iGenomes (e.g. with --genome GRCh38), it tries to index the genome and the pipeline will crash due to this step running out of memory.

BWA MEM2 requires ~84GB for indexing of GRCh38 - https://github.com/bwa-mem2/bwa-mem2/blob/master/README.md describes it as "# Indexing the reference sequence (Requires 28N GB memory where N is the size of the reference sequence)."

Command used and terminal output

No response

Relevant files

No response

System information

No response

@lfearnley lfearnley added the bug Something isn't working label Jul 18, 2023
@ramprasadn
Copy link
Collaborator

@lfearnley the default configurations used in raredisease are written keeping the test profile(&dataset, which is tiny) in mind. You should override these values like @fa2k has done in his configs here to get it to work on larger datasets.

@lfearnley
Copy link
Author

@ramprasadn - yep, makes sense - might be worth adding to docs?

@ramprasadn
Copy link
Collaborator

Good point! Will do 👍🏻
I will reopen this issue and add it to the next milestone so we don't forget to add this info to docs

@ramprasadn ramprasadn reopened this Jul 21, 2023
@ramprasadn ramprasadn added this to the Release 1.2.0 milestone Jul 21, 2023
@ramprasadn ramprasadn mentioned this issue Aug 1, 2023
11 tasks
@ramprasadn
Copy link
Collaborator

Fixed in #394

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants