Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

switch to using gather exclusively, away from LCA methods. #110

Merged
merged 36 commits into from
Aug 26, 2020

Conversation

ctb
Copy link
Member

@ctb ctb commented Jun 1, 2020

exploring #33.

This PR disables LCA-based decontamination, reasons 2 and 3.

It also includes #122 which switches to using search --containment instead of gather, so as to enable decontamination of sequences that are in the search database. You'll need to rerun charcoal from scratch to make full use of this new feature.

@ctb
Copy link
Member Author

ctb commented Jul 9, 2020

Note, GCA_003220225.1_genomic.fna.gz looks like a good test case for this one.

@ctb ctb changed the title augment analysis of clean contigs with indication of contaminants switch to using gather exclusively, away from LCA methods. Jul 12, 2020
ctb added 9 commits July 12, 2020 07:41
* add explicit moltype to config

* add protein conf file

* first full successful run

* add gather_scaled to do faster searches

* adjust thresholds for protein

* use search rather than gather so we can look at GTDB 25k genomes

* upd

* refactor exact removal a bit

* improve reporting

* improve reporting

* silence lineages file warnings

* add gtdb conf

* require provided lineage to remove exact match

* flag identical matches removed

* clean up reporting etc
@ctb ctb changed the base branch from master to latest August 22, 2020 13:02
* initial attempt to add snakemake tests

* snakemake tests working

* add test on protein side, too
* attempted refactor try 1

* look at many genomes at once

* tentatively working?

* start generating summaries

* do progress elimination/reporting

* add summarize rule

* add provided lin to ibd2

* output CSV

* recover comment

* add f_major and f_ident to output

* update for tara-delmont

* remove lineage split

* get protein working

* fix provided lineage bug

* fix self-matching

* fix snakemake tests

* write actual genome cleaning code

* make min_f_ident and min_f_major configurable

* swizzle f_match and f_ident rows to later; sort output by total_bad_bp

* clean up imports a bit

* 'fix' tests by commenting many of them out

* pyflakes cleanup

* refactor and cleanup

* refactor and cleanup

* refactor and cleanup

* require genus-level match rank, for now.

* eliminate match_rank as a configurable parameter

* make use of gather threshold in contig classification

* more refactoring and cleanup

* rescue contigs that still have significant matches to correct lineage
@ctb
Copy link
Member Author

ctb commented Aug 26, 2020

  • rewrite at least some of the documentation to cover new multistep approach.

@ctb ctb merged commit 877cdf5 into latest Aug 26, 2020
@ctb ctb deleted the whole_genome_clean branch August 26, 2020 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant