Skip to content

Commit

Permalink
Merge pull request #146 from JoseEspinosa/updates
Browse files Browse the repository at this point in the history
Use same ubuntu version for all process and hopefully improve process tagging
  • Loading branch information
luisas authored Sep 16, 2024
2 parents c84b0ed + 38d8786 commit 37d2a1b
Show file tree
Hide file tree
Showing 7 changed files with 83 additions and 53 deletions.
29 changes: 15 additions & 14 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,18 +9,18 @@ Initial release of nf-core/multiplesequencealign, created with the [nf-core](htt

### `Added`

- [[#29](https://github.com/nf-core/multiplesequencealign/issues/29)] - Add FAMSA_ALIGN module
- [[#38](https://github.com/nf-core/multiplesequencealign/issues/38)] - Add FAMSA_GUIDETREE module
- [[#42](https://github.com/nf-core/multiplesequencealign/issues/42)] - Add MAFFT module
- [[#51](https://github.com/nf-core/multiplesequencealign/issues/51)] - Add CLUSTALO module
- [[#41](https://github.com/nf-core/multiplesequencealign/issues/41)] - Add KALIGN module
- [[#48](https://github.com/nf-core/multiplesequencealign/issues/48)] - Integrate NF-VALIDATION PLUGIN
- [[#29](https://github.com/nf-core/multiplesequencealign/issues/29)] - Add FAMSA_ALIGN module.
- [[#38](https://github.com/nf-core/multiplesequencealign/issues/38)] - Add FAMSA_GUIDETREE module.
- [[#42](https://github.com/nf-core/multiplesequencealign/issues/42)] - Add MAFFT module.
- [[#51](https://github.com/nf-core/multiplesequencealign/issues/51)] - Add CLUSTALO module.
- [[#41](https://github.com/nf-core/multiplesequencealign/issues/41)] - Add KALIGN module.
- [[#48](https://github.com/nf-core/multiplesequencealign/issues/48)] - Integrate NF-VALIDATION PLUGIN.
- [[#45](https://github.com/nf-core/multiplesequencealign/issues/45)] - Add module LearnMSA
- [[#35](https://github.com/nf-core/multiplesequencealign/issues/35)] - Add module Tcoffee_align
- [[#60](https://github.com/nf-core/multiplesequencealign/issues/60)] - Add module Tcoffee3D_align and handle structures input
- [[#35](https://github.com/nf-core/multiplesequencealign/issues/35)] - Add module MUSCLE5_SUPER5
- [[#35](https://github.com/nf-core/multiplesequencealign/issues/35)] - Add module Tcoffee_align.
- [[#60](https://github.com/nf-core/multiplesequencealign/issues/60)] - Add module Tcoffee3D_align and handle structures input.
- [[#35](https://github.com/nf-core/multiplesequencealign/issues/35)] - Add module MUSCLE5_SUPER5.
- [[#59](https://github.com/nf-core/multiplesequencealign/issues/59)] - Add support for passing structure template in samplesheet.
- [[#77](https://github.com/nf-core/multiplesequencealign/issues/77)] - Add module zip
- [[#77](https://github.com/nf-core/multiplesequencealign/issues/77)] - Add module zip.
- [[#93](https://github.com/nf-core/multiplesequencealign/pull/93)] - Add multiqc basic support. Add custom params validation. Add basic shiny app.
- [[#100](https://github.com/nf-core/multiplesequencealign/pull/100)] - Add support for optional stats and evals. Clean tests.
- [[#110](https://github.com/nf-core/multiplesequencealign/issues/110)] - Add Readme documentation. Add nf-test for the pipeline.
Expand All @@ -30,8 +30,9 @@ Initial release of nf-core/multiplesequencealign, created with the [nf-core](htt
- [[#90](https://github.com/nf-core/multiplesequencealign/issues/90)] - Add TCS evaluation metric.
- [[#89](https://github.com/nf-core/multiplesequencealign/issues/89)] - Add collection of plddt metrics in stats subworkflow.
- [[#96](https://github.com/nf-core/multiplesequencealign/issues/96)] - Add collection of number of gaps in eval subworkflow.
- [[#84](https://github.com/nf-core/multiplesequencealign/issues/84)] - Update Metromap
- [[#139](https://github.com/nf-core/multiplesequencealign/pull/139)] - Add Foldmason
- [[#84](https://github.com/nf-core/multiplesequencealign/issues/84)] - Update Metromap.
- [[#139](https://github.com/nf-core/multiplesequencealign/pull/139)] - Add Foldmason.
- [[#146](https://github.com/nf-core/multiplesequencealign/pull/146)] - Only show additional process tags when they exists and use the same ubuntu version in all modules.

### `Fixed`

Expand All @@ -42,8 +43,8 @@ Initial release of nf-core/multiplesequencealign, created with the [nf-core](htt
- [[#80](https://github.com/nf-core/multiplesequencealign/pull/80)] - Update modules versions from nf-core tools with nf-test.
- [[#32](https://github.com/nf-core/multiplesequencealign/issues/32)] - Update Stats workflow with nf-core modules for merging.
- [[#81](https://github.com/nf-core/multiplesequencealign/pull/81)] - Update Eval workflow with nf-core modules for merging.
- [[#111](https://github.com/nf-core/multiplesequencealign/pull/111)] - Fix linting warnings (mostly versions)
- [[#134](https://github.com/nf-core/multiplesequencealign/pull/134)] - Code revision for release preparation
- [[#111](https://github.com/nf-core/multiplesequencealign/pull/111)] - Fix linting warnings (mostly versions).
- [[#134](https://github.com/nf-core/multiplesequencealign/pull/134)] - Code revision for release preparation.
- [[#138](https://github.com/nf-core/multiplesequencealign/pull/138)] - MultiQC as nf-core module and fix visualization.

### `Dependencies`
Expand Down
87 changes: 58 additions & 29 deletions conf/modules.config
Original file line number Diff line number Diff line change
Expand Up @@ -16,15 +16,15 @@
// Statistics about the input sequences
//

withName: "CALCULATE_SEQSTATS"{
withName: "CALCULATE_SEQSTATS" {
publishDir = [
path: { "${params.outdir}/summary/stats/sequences/seqstats" },
mode: params.publish_dir_mode,
saveAs: { filename -> filename.equals('versions.yml')|filename.contains('_summary.csv') ? null : filename }
]
}

withName: "CONCAT_SEQSTATS"{
withName: "CONCAT_SEQSTATS" {
ext.prefix = { "summary_seqstats" }
}

Expand All @@ -36,7 +36,7 @@
]
}

withName: "CONCAT_PLDDT"{
withName: "CONCAT_PLDDT" {
ext.prefix = { "summary_plddt" }
}

Expand All @@ -49,7 +49,7 @@
]
}

withName: "CONCAT_SIMSTATS"{
withName: "CONCAT_SIMSTATS" {
ext.prefix = { "summary_simstats" }
}

Expand All @@ -67,8 +67,13 @@
// Tree building
//

withName: "FAMSA_GUIDETREE"{
tag = { "${meta.id} args:${meta.args_tree}" }
withName: "FAMSA_GUIDETREE" {
tag = {
[
"${meta.id}",
meta.args_tree ? "args: ${meta.args_tree}" : ""
].join(' ').trim()
}
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}" }
ext.args = { "${meta.args_tree}" == "null" ? '' : "${meta.args_tree}" }
publishDir = [
Expand All @@ -78,8 +83,13 @@
]
}

withName: "CLUSTALO_GUIDETREE"{
tag = { "${meta.id} args:${meta.args_tree}" }
withName: "CLUSTALO_GUIDETREE" {
tag = {
[
"${meta.id}",
meta.args_tree ? "args: ${meta.args_tree}" : ""
].join(' ').trim()
}
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}" }
ext.args = { "${meta.args_tree}" == "null" ? '' : "${meta.args_tree}" }
publishDir = [
Expand All @@ -89,8 +99,13 @@
]
}

withName: "MAGUS_GUIDETREE"{
tag = { "${meta.id} args:${meta.args_tree}" }
withName: "MAGUS_GUIDETREE" {
tag = {
[
"${meta.id}",
meta.args_tree ? "args: ${meta.args_tree}" : ""
].join(' ').trim()
}
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}" }
ext.args = { "${meta.args_tree}" == "null" ? '' : "${meta.args_tree}" }
publishDir = [
Expand All @@ -104,12 +119,19 @@
// Alignment
//

withName: "CREATE_TCOFFEETEMPLATE"{
withName: "CREATE_TCOFFEETEMPLATE" {
ext.prefix = { "${meta.id}" }
}

withName: "CLUSTALO_ALIGN|FAMSA_ALIGN|LEARNMSA_ALIGN|MAFFT|MAGUS_ALIGN|MUSCLE5_SUPER5|REGRESSIVE|TCOFFEE_ALIGN|TCOFFEE3D_ALIGN|FOLDMASON_EASYMSA"{
tag = { "${meta.id} tree:${meta.tree} argstree:${args_tree} args:${meta.args_aligner}" }
withName: "CLUSTALO_ALIGN|FAMSA_ALIGN|LEARNMSA_ALIGN|MAFFT|MAGUS_ALIGN|MUSCLE5_SUPER5|REGRESSIVE|TCOFFEE_ALIGN|TCOFFEE3D_ALIGN|FOLDMASON_EASYMSA" {
tag = {
[
"${meta.id}",
meta.tree ? "tree: ${meta.tree}" : "",
meta.args_tree ? "argstree: ${meta.args_tree}" : "",
meta.args_aligner ? "args: ${meta.args_aligner}" : ""
].join(' ').trim()
}
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}" }
ext.args = { "${meta.args_aligner}" == "null" ? '' : "${meta.args_aligner}" }
if(params.skip_compression){
Expand All @@ -121,8 +143,15 @@
}
}

withName: "MTMALIGN_ALIGN"{
tag = { "${meta.id} tree:${meta.tree} argstree:${args_tree} args:${meta.args_aligner}" }
withName: "MTMALIGN_ALIGN" {
tag = {
[
"${meta.id}",
meta.tree ? "tree: ${meta.tree}" : "",
meta.args_tree ? "argstree: ${meta.args_tree}" : "",
meta.args_aligner ? "args: ${meta.args_aligner}" : ""
].join(' ').trim()
}
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}" }
ext.args = { "${meta.args_aligner}" == "null" ? '' : "${meta.args_aligner}" }
if(params.skip_compression){
Expand All @@ -136,7 +165,7 @@

}

withName:"PIGZ_COMPRESS"{
withName:"PIGZ_COMPRESS" {
publishDir = [
path: { "${params.outdir}/alignment/${meta.id}" },
mode: params.publish_dir_mode,
Expand All @@ -148,21 +177,21 @@
// Alignment evaluation
//

withName: 'PARSE_IRMSD'{
withName: 'PARSE_IRMSD' {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_irmsd" }
}

withName: 'TCOFFEE_ALNCOMPARE_SP'{
withName: 'TCOFFEE_ALNCOMPARE_SP' {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_sp" }
ext.args = "-compare_mode sp"
}

withName: 'TCOFFEE_ALNCOMPARE_TC'{
withName: 'TCOFFEE_ALNCOMPARE_TC' {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_tc" }
ext.args = "-compare_mode tc"
}

withName: 'TCOFFEE_IRMSD'{
withName: 'TCOFFEE_IRMSD' {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_irmsd" }
publishDir = [
path: { "${params.outdir}/evaluation/${task.process.tokenize(':')[-1].toLowerCase()}" },
Expand All @@ -171,31 +200,31 @@
]
}

withName: "CALC_GAPS"{
withName: "CALC_GAPS" {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_gaps" }
}

withName: "CONCAT_IRMSD"{
withName: "CONCAT_IRMSD" {
ext.prefix = { "summary_irmsd" }
}

withName: "CONCAT_GAPS"{
withName: "CONCAT_GAPS" {
ext.prefix = { "summary_gaps" }
}

withName: "CONCAT_SP"{
withName: "CONCAT_SP" {
ext.prefix = { "summary_sp" }
}

withName: "CONCAT_TC"{
withName: "CONCAT_TC" {
ext.prefix = { "summary_tc" }
}

withName: "CONCAT_TCS"{
withName: "CONCAT_TCS" {
ext.prefix = { "summary_tcs" }
}

withName: 'TCOFFEE_TCS'{
withName: 'TCOFFEE_TCS' {
ext.prefix = { "${meta.id}_${meta.tree}-args-${meta.argstree_clean}_${meta.aligner}-args-${meta.args_aligner_clean}_tcs" }
publishDir = [
path: { "${params.outdir}/evaluation/${task.process.tokenize(':')[-1].toLowerCase()}" },
Expand All @@ -204,7 +233,7 @@
]
}

withName: "MERGE_EVAL"{
withName: "MERGE_EVAL" {
ext.prefix = { "complete_summary_eval" }
ext.args = "-f 1,2,3,4,5,6,7 -O"
publishDir = [
Expand All @@ -214,7 +243,7 @@
]
}

withName: "MERGE_STATS_EVAL"{
withName: "MERGE_STATS_EVAL" {
ext.prefix = { "complete_summary_stats_eval" }
ext.args = "-f 1 -O"
publishDir = [
Expand Down
4 changes: 2 additions & 2 deletions modules/local/calculate_gaps.nf
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ process CALC_GAPS {
label 'process_low'

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/ubuntu:20.04' :
'nf-core/ubuntu:20.04' }"
'https://depot.galaxyproject.org/singularity/ubuntu:22.04' :
'nf-core/ubuntu:22.04' }"

input:
tuple val(meta), path(msa)
Expand Down
4 changes: 2 additions & 2 deletions modules/local/create_tcoffee_template.nf
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ process CREATE_TCOFFEETEMPLATE {
label 'process_low'

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/ubuntu:20.04' :
'nf-core/ubuntu:20.04' }"
'https://depot.galaxyproject.org/singularity/ubuntu:22.04' :
'nf-core/ubuntu:22.04' }"

input:
tuple val(meta), val(suffix), path(accessory_informations)
Expand Down
4 changes: 2 additions & 2 deletions modules/local/extract_plddt.nf
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ process EXTRACT_PLDDT {
label 'process_low'

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/ubuntu:20.04' :
'nf-core/ubuntu:20.04' }"
'https://depot.galaxyproject.org/singularity/ubuntu:22.04' :
'nf-core/ubuntu:22.04' }"

input:
tuple val(meta), path(structures)
Expand Down
4 changes: 2 additions & 2 deletions modules/local/parse_sim.nf
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ process PARSE_SIM {
label 'process_low'

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/ubuntu:20.04' :
'nf-core/ubuntu:20.04' }"
'https://depot.galaxyproject.org/singularity/ubuntu:22.04' :
'nf-core/ubuntu:22.04' }"

input:
tuple val(meta), path(infile)
Expand Down
4 changes: 2 additions & 2 deletions modules/local/prepare_shiny.nf
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ process PREPARE_SHINY {
label 'process_low'

container "${ workflow.containerEngine == 'singularity' && !task.ext.singularity_pull_docker_container ?
'https://depot.galaxyproject.org/singularity/ubuntu:20.04' :
'nf-core/ubuntu:20.04' }"
'https://depot.galaxyproject.org/singularity/ubuntu:22.04' :
'nf-core/ubuntu:22.04' }"

input:
tuple val(meta), path(table)
Expand Down

0 comments on commit 37d2a1b

Please sign in to comment.