Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update krakenuniq #550

Draft
wants to merge 3 commits into
base: dev
Choose a base branch
from
Draft

Update krakenuniq #550

wants to merge 3 commits into from

Conversation

Midnighter
Copy link
Collaborator

@Midnighter Midnighter commented Oct 31, 2024

Please note that the module changes are currently copied over from a module update that I'm trying to get merged nf-core/modules#6912. That needs to be reverted later and the module updated properly.

This PR changes some of the channel plumbing to introduce a prefix for each sequencing reads file (or pairs).

Some doubt remains about the use of meta.id as the prefix. I think, that refers to the sample identifier which may be non-unique if multiple runs are not merged. Potentially, that has to be changed to something else.

I have run a local test and it seems to address #533

The KrakenUniq module has a breaking change requiring a further input.
@Midnighter Midnighter self-assigned this Oct 31, 2024
Copy link

github-actions bot commented Oct 31, 2024

nf-core pipelines lint overall result: Passed ✅

Posted for pipeline commit c0311a1

+| ✅ 281 tests passed       |+

✅ Tests passed:

Run details

  • nf-core/tools version 3.0.2
  • Run at 2024-11-06 09:18:49

@jfy133 jfy133 marked this pull request as draft November 5, 2024 11:29
Copy link
Member

@jfy133 jfy133 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM (and tested) once the official module is updated

@Midnighter Midnighter marked this pull request as ready for review November 5, 2024 19:46
@Midnighter
Copy link
Collaborator Author

@jfy133 did you by any chance test this also without run merging? I'm still a bit in doubt about the meta.id.

Copy link
Member

@jfy133 jfy133 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ONe thing I didn't check is if Taxpasta is still OK with this (no missing data), I'm assuming as it didn't fail it's OK but can you confirm from your tests @Midnighter ?

@jfy133
Copy link
Member

jfy133 commented Nov 6, 2024

Oh haha, just saw your question! will see if I can run again (DB wifi though)

@Midnighter
Copy link
Collaborator Author

How do you think taxpasta would be affected? I don't see a potential risk right now?

@jfy133
Copy link
Member

jfy133 commented Nov 6, 2024

Same issue as you were referring to really - file names. I'm stuck on porechop_ABI for some reason, but suspect it's waiting for something to download still :grimace:

@Midnighter
Copy link
Collaborator Author

The taxpasta module uses a proper prefix definition, so I there should be no issues, there.

def prefix = task.ext.prefix ?: "${meta.id}"

@jfy133 jfy133 marked this pull request as draft November 11, 2024 08:03
@jfy133
Copy link
Member

jfy133 commented Nov 11, 2024

Currently doesn't work because of a file collision when there are SE and PE data in one run and run merging is not performed, as it results in file collisions.

I think it needs a mdoules.conf update that a KrakenUniq SE run has se appended to the prefix, and pe for the paired end (for example)

@Midnighter
Copy link
Collaborator Author

Unfortunately, can't use module config due to the batching :( but I'll update the pipeline channel logic.

@jfy133
Copy link
Member

jfy133 commented Nov 11, 2024

Maybe embed it in the module? I think it it reasonable in this case

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants