Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: Remove Balsamic container 👋 👋 #1220

Merged
merged 70 commits into from
Aug 10, 2023
Merged
Changes from 1 commit
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
9e5bff2
Remove unused imports analysis models
ivadym Jul 18, 2023
fc5f85e
Create Snakemake model
ivadym Jul 20, 2023
10e721c
Update init workflow
ivadym Jul 21, 2023
2134fa1
Remove empty new line
ivadym Jul 21, 2023
c2e7257
Snakemake model integrity tests
ivadym Jul 24, 2023
5b1eae3
Models methods pytests
ivadym Jul 25, 2023
55ba76b
Remove unused pytests
ivadym Jul 25, 2023
edf56c0
Add benchmark as a model option
ivadym Jul 25, 2023
de0fe16
Update run analysis
ivadym Jul 25, 2023
c34d40c
Update deliver.py
ivadym Jul 25, 2023
393df1c
Rename fixtures
ivadym Jul 25, 2023
08214d0
Merge branch 'develop' of github.com:Clinical-Genomics/BALSAMIC into …
ivadym Jul 25, 2023
161803f
Rename command method name
ivadym Jul 25, 2023
033248c
Add additional method for config files
ivadym Jul 25, 2023
a919bab
Split subprocess submission command
ivadym Jul 25, 2023
e104ab5
CHANGELOG
ivadym Jul 25, 2023
a56da8d
1211
ivadym Jul 25, 2023
b4933f3
Pytest mail user
ivadym Jul 26, 2023
91ac79b
Test pon cnn
ivadym Jul 26, 2023
fc39962
Undo PON
ivadym Jul 26, 2023
753341b
Push containers
ivadym Jul 26, 2023
06bab07
Undo push
ivadym Jul 26, 2023
45f04d1
Merge develop
ivadym Jul 28, 2023
88e832a
Update CHANGELOG.rst
ivadym Jul 28, 2023
d5f4804
Update CHANGELOG.rst
ivadym Jul 28, 2023
4115fda
Review: Typehint comments singularity_bind_path
ivadym Jul 28, 2023
160d0ca
Move cache utils to utils :p
ivadym Jul 28, 2023
15cd6ce
Review: move methods
ivadym Jul 28, 2023
4d0f0d5
Merge branch 'refactor-bind-path-singularity' of github.com:Clinical-…
ivadym Jul 28, 2023
51ed5ba
pon pon pon poooon
ivadym Jul 28, 2023
efbdbd5
Missing capture kit key
ivadym Jul 28, 2023
ec44f43
TEST 0: bind path
ivadym Jul 28, 2023
105fc76
TEST 0: completed
ivadym Jul 28, 2023
cbd3cc0
Remove extra space :p
ivadym Jul 28, 2023
788a39c
Merge branch 'develop' into refactor-bind-path-singularity
ivadym Aug 1, 2023
8ca2356
Update dependency versions
ivadym Aug 4, 2023
948c3b6
Update balsamic container
ivadym Aug 4, 2023
24530cc
Update docs
ivadym Aug 4, 2023
aeb15d5
CHANGELOG
ivadym Aug 4, 2023
5dbc49d
Update conda environment
ivadym Aug 4, 2023
88c71ce
Push containers :rocket
ivadym Aug 4, 2023
1d8bfea
Add command to snakemake
ivadym Aug 4, 2023
19e1eaa
uppercase
ivadym Aug 4, 2023
3686747
Update GitHub Actions & docs python version
ivadym Aug 4, 2023
01c5f59
Fixed version
ivadym Aug 4, 2023
9e325e6
Update pytests
ivadym Aug 4, 2023
4607748
Fix
ivadym Aug 7, 2023
a7dbda0
CHANGELOG
ivadym Aug 7, 2023
b50e182
Merge branch 'fix-rm-temp' of github.com:Clinical-Genomics/BALSAMIC i…
ivadym Aug 7, 2023
1eb45d3
Merge branch 'fix-rm-temp' into refactor-bind-path-singularity
ivadym Aug 7, 2023
e20645a
Merge branch 'refactor-bind-path-singularity' into fix-snakemake-rerun
ivadym Aug 7, 2023
33ca244
Merge branch 'fix-snakemake-rerun' into update-python
ivadym Aug 7, 2023
9b04af9
Review
ivadym Aug 7, 2023
9c13b9b
Merge branch 'fix-rm-temp' into refactor-bind-path-singularity
ivadym Aug 7, 2023
63cb8e1
Merge branch 'develop' into refactor-bind-path-singularity
ivadym Aug 7, 2023
598a66e
Merge branch 'refactor-bind-path-singularity' into fix-snakemake-rerun
ivadym Aug 7, 2023
48d6158
Merge develop
ivadym Aug 7, 2023
0697500
Merge branch 'fix-snakemake-rerun' into update-python
ivadym Aug 7, 2023
77e8fc8
Undo push to docker
ivadym Aug 7, 2023
51fa769
Merge branch 'develop' of github.com:Clinical-Genomics/BALSAMIC into …
ivadym Aug 7, 2023
77875b5
Remove Balsamic container
ivadym Aug 8, 2023
a1d9e24
Update conftest
ivadym Aug 8, 2023
4458276
CHANGELOG
ivadym Aug 8, 2023
7f4a00f
Kommatecken
ivadym Aug 8, 2023
9fadf04
Update .github/workflows/docker_build_push.yml
ivadym Aug 9, 2023
6f84080
Update .github/workflows/docker_build_push_release.yml
ivadym Aug 9, 2023
3399301
Review
ivadym Aug 9, 2023
fd98ed2
Review: update comment
ivadym Aug 9, 2023
859b7bd
Merge branch 'update-python' into remove-balsamic-container
ivadym Aug 9, 2023
d7dea91
Merge develop
ivadym Aug 10, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Rename command method name
  • Loading branch information
ivadym committed Jul 25, 2023
commit 161803f746f106d679f6d68b141bd804f4f282f6
2 changes: 1 addition & 1 deletion BALSAMIC/commands/init/base.py
Original file line number Diff line number Diff line change
@@ -166,6 +166,6 @@ def initialize(
working_dir=references_dir,
)
subprocess.run(
f"{sys.executable} -m {snakemake_executable.get_snakemake_command()}",
f"{sys.executable} -m {snakemake_executable.get_command()}",
shell=True,
)
16 changes: 7 additions & 9 deletions BALSAMIC/commands/report/deliver.py
Original file line number Diff line number Diff line change
@@ -92,10 +92,8 @@ def deliver(
analysis_workflow = sample_config_dict["analysis"]["analysis_workflow"]
snakefile = get_snakefile(analysis_type, analysis_workflow)

report_file_name = os.path.join(
yaml_write_directory, sample_config_dict["analysis"]["case_id"] + "_report.html"
)
LOG.info("Creating report file {}".format(report_file_name))
report_path = Path(yaml_write_directory, f"{case_name}_report.html")
LOG.info(f"Creating report file {report_path.as_posix()}")

LOG.info(f"Delivering {analysis_workflow} workflow...")
working_dir = Path(
@@ -105,7 +103,7 @@ def deliver(
case_id=case_name,
config_path=sample_config,
disable_variant_caller=disable_variant_caller,
report_path=report_file_name,
report_path=report_path,
run_analysis=True,
run_mode=RunMode.LOCAL,
snakefile=snakefile,
@@ -114,10 +112,10 @@ def deliver(
)

subprocess.check_output(
f"{sys.executable} -m {snakemake_executable.get_snakemake_command().split()}",
f"{sys.executable} -m {snakemake_executable.get_command().split()}",
shell=False,
)
LOG.info(f"Workflow report file {report_file_name}")
LOG.info(f"Workflow report file {report_path.as_posix()}")

snakemake.snakemake(
snakefile=snakefile,
@@ -146,9 +144,9 @@ def deliver(
# Add Housekeeper file to report
delivery_json["files"].append(
{
"path": report_file_name,
"path": report_path.as_posix(),
"step": "balsamic_delivery",
"format": get_file_extension(report_file_name),
"format": get_file_extension(report_path.as_posix()),
"tag": ["balsamic-report"],
"id": case_name,
}
2 changes: 1 addition & 1 deletion BALSAMIC/commands/run/analysis.py
Original file line number Diff line number Diff line change
@@ -273,7 +273,7 @@ def analysis(
working_dir=Path(analysis_dir, case_name, "BALSAMIC_run"),
)
subprocess.run(
f"{sys.executable} -m {snakemake_executable.get_snakemake_command()}",
f"{sys.executable} -m {snakemake_executable.get_command()}",
shell=True,
)

2 changes: 1 addition & 1 deletion BALSAMIC/models/snakemake.py
Original file line number Diff line number Diff line change
@@ -149,7 +149,7 @@ def get_snakemake_options_command(self) -> str:
return " ".join(self.snakemake_options)
return ""

def get_snakemake_command(self) -> str:
def get_command(self) -> str:
"""Return Snakemake command to be submitted."""
snakemake_command: str = (
f"snakemake --notemp -p "
2 changes: 1 addition & 1 deletion tests/models/test_snakemake_models.py
Original file line number Diff line number Diff line change
@@ -209,7 +209,7 @@ def test_get_snakemake_command(
# GIVEN a snakemake_executable model with working environment paths

# WHEN calling the method
snakemake_command: str = snakemake_executable.get_snakemake_command()
snakemake_command: str = snakemake_executable.get_command()

# THEN the expected format should be returned
assert (