Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add TIDDIT tumor normal filtering #1120

Merged
merged 47 commits into from
Apr 26, 2023
Merged

feat: add TIDDIT tumor normal filtering #1120

merged 47 commits into from
Apr 26, 2023

Conversation

mathiasbio
Copy link
Collaborator

@mathiasbio mathiasbio commented Mar 24, 2023

This PR:

Aims to reduce the number of structural variants in the final SV & CNV VCF.
Currently solely by adding filters to the TIDDIT rules which removes SVs that have been called in the normal sample as well (only relevant for WGS tumor normal analyses).

Added: for new features.

  • Filter away variants present in the normal sample in merged TIDDIT vcf

Further information about implementation and testing can be found in this issue: #1119
And this discussion: #1127

Tests done

The only type of analyses running the rule affected by this change is WGS T / N.

  • Install branch on Hasta
  • Run analysis on WGS T / N case hardyweevil
  • Analysis succeeding without errors
  • Variants filtered out as intended due to presence of evidence in normal-sample

Review and tests:

  • Tests pass
  • Code review
  • New code is executed and covered by tests, and test approve

@github-advanced-security
Copy link

You have successfully added a new SonarCloud configuration ``. As part of the setup process, we have scanned this repository and found no existing alerts. In the future, you will see all code scanning alerts on the repository Security tab.

@codecov
Copy link

codecov bot commented Mar 24, 2023

Codecov Report

Patch and project coverage have no change.

Comparison is base (c9630fb) 99.31% compared to head (9417c89) 99.31%.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #1120   +/-   ##
========================================
  Coverage    99.31%   99.31%           
========================================
  Files           29       29           
  Lines         1756     1756           
========================================
  Hits          1744     1744           
  Misses          12       12           
Flag Coverage Δ
unittests 99.31% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@mathiasbio mathiasbio changed the title Feat filter SVs Feat: filter SVs Mar 27, 2023
@mathiasbio mathiasbio self-assigned this Mar 27, 2023
@mathiasbio mathiasbio changed the title Feat: filter SVs feat: filter SVs Mar 27, 2023
@mathiasbio mathiasbio marked this pull request as ready for review April 25, 2023 14:29
@mathiasbio mathiasbio requested review from a team and removed request for fevac April 25, 2023 14:29
Copy link
Contributor

@ivadym ivadym left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great with your new changes, way easier to follow and understand! Great job! 🎖️

I left you some minor comments. With that and after addressing the sonarcloud complains I think we'll be good to go 🚀

BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Show resolved Hide resolved
BALSAMIC/assets/scripts/filter_SVs.py Show resolved Hide resolved
Copy link
Contributor

@ivadym ivadym left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fantastic work @mathiasbio 💯 ⭐

BALSAMIC/assets/scripts/filter_SVs.py Outdated Show resolved Hide resolved
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@mathiasbio mathiasbio merged commit 35edf7e into develop Apr 26, 2023
@mathiasbio mathiasbio deleted the feat_filter_SVs branch April 26, 2023 18:28
@ivadym ivadym mentioned this pull request Apr 27, 2023
14 tasks
ivadym added a commit that referenced this pull request May 10, 2023
### Added:
* PIP specific missing tools to config #1096
* Filtering script to remove normal variants from TIDDIT #1120
* Store TMB files in HK #1144

### Changed:
* Fixed all conda container dependencies #1096
* Changed --max_sv_size in VEP params to the size of chr1 for hg19 #1124
* Increased time-limit for sambamba_exon_depth and picard_markduplicates to 6 hours #1143
* Update cosmicdb to v97 #1147
* Updated read the docs with the changes relevant to mention #1153

### Fixed:
* Update cryptography version (39.0.1) due to security alert #1087
* Bump cryptography to v40.0.2 and gsutil to v5.23 #1154
* Pytest file saved in balsamic directory #1093
* Fix varcall_py3 container bcftools dependency error #1097
* AscatNgs container #1155
@ivadym ivadym mentioned this pull request Jul 19, 2023
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

improve filtering of structural variants Increased number of SVs in versions after 9.0.1
3 participants