Skip to content

Latest commit

 

History

History
79 lines (59 loc) · 3.32 KB

04_cleanup.md

File metadata and controls

79 lines (59 loc) · 3.32 KB

04 - Cleanup

Created: 2022/12/12 12:36:19 Last modified: 2023/02/24 10:31:27

  • Aim: This document outlines how to back up the analyses on the dedicated space on production and cleanup
  • Prerequisite software: rsync
  • OS:

Table of contents

Backup analyses and cleanup

Minimal analyses will be backed up at /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/

Directory structure:

/NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/
├── [ 127]  Adipose_AS_RRMS
│   ├── [   0]  CNV
│   ├── [   0]  QC
│   ├── [   0]  SNP
│   ├── [  68]  SV
│   ├── [   0]  bam
│   └── [   0]  methyl
└── [ 127]  Adipose_AS_ours
    ├── [ 503]  CNV
    ├── [ 149]  QC
    ├── [  82]  SNP
    ├── [  68]  SV
    ├── [  96]  bam
    └── [ 211]  methyl

14 directories, 0 files

Move analyses to be backed up, for example for sample AB792A for the "Adipose_AS_ours" sequencing

# make sure you have created your bash variables defining the sample and working directory
SAMPLE="AB792A"
WKDIR="/NGS/humangenomics/active/2022/run/ont_human_workflow/"
EXPERIMENT="Adipose_AS_ours"

# bams
rsync -av "${WKDIR}"/results/04-ont-whatshap-phase/"${SAMPLE}"/* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/bam/

# snp
rsync -av "${WKDIR}"/results/03-ont-wf-human-variation-calling/"${SAMPLE}"/"${SAMPLE}".wf_snp.vcf.gz* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/SNP/

# sv
rsync -av "${WKDIR}"/results/03-ont-wf-human-variation-calling/"${SAMPLE}"/"${SAMPLE}".wf_sv.vcf.gz* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/SV/wf-human-variation-calling/
rsync -av "${WKDIR}"/results/06-ont-sv-cutesv/"${SAMPLE}"/"${SAMPLE}"_sv_cutesv.vcf.gz* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/SV/cutesv/

# methylation
rsync -av "${WKDIR}"/results/05-ont-methyl-calling/"${SAMPLE}"/* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/methyl/

# CNV
rsync -av "${WKDIR}"/results/07-ont-wf-human-cnv/"${SAMPLE}"/output/qdna_seq/* /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/CNV/

# QC
rsync -av "${WKDIR}"/results/03-ont-wf-human-variation-calling/"${SAMPLE}"/"${SAMPLE}".wf-human-snp-report.html /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/QC/
rsync -av "${WKDIR}"/results/03-ont-wf-human-variation-calling/"${SAMPLE}"/"${SAMPLE}".wf-human-sv-report.html /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/QC/
rsync -av "${WKDIR}"/results/07-ont-wf-human-cnv/"${SAMPLE}"/output/"${SAMPLE}"_fastq_wf-cnv-report.html /NGS/clinicalgenomics/archive/2022/results/adipose_ont_methylation/${EXPERIMENT}/QC/

Clean up after analysis is confirmed to be backed up

rm -rf "${WKDIR}"/results/*/"${SAMPLE}"/
rm -rf "${WKDIR}"/fast5/"${SAMPLE}"/

ONLY RUN THIS ONCE YOU'RE CERTAIN THE DATA IS SUCCESSFULLY BACKED UP - otherwise bye bye data - check several times for typos because humans always make mistakes