Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace tmp_dir directory in BaseRecalibration #221

Merged
merged 1 commit into from
Jun 22, 2020
Merged

Replace tmp_dir directory in BaseRecalibration #221

merged 1 commit into from
Jun 22, 2020

Conversation

FriederikeHanssen
Copy link
Contributor

@FriederikeHanssen FriederikeHanssen commented Jun 22, 2020

nf-core/sarek pull request

Many thanks for contributing to nf-core/sarek!

Please fill in the appropriate checklist below (delete whatever is not relevant).
These are the most common things requested on pull requests (PRs).

PR checklist

  • This comment contains a description of changes (with reason)
  • If you've fixed a bug or added code that should be tested, add tests!
  • If necessary, also make a PR on the nf-core/sarek branch on the nf-core/test-datasets repo
  • Ensure the test suite passes (nextflow run . -profile test,docker).
  • Make sure your code lints (nf-core lint .).
  • Documentation in docs is updated
  • CHANGELOG.md is updated
  • README.md is updated

Learn more about contributing: CONTRIBUTING.md

I experienced issues with the option --tmp_dir in the process BaseRecalibration being hardcoded to /tmp since in our setup this directory is not big enough. We use the setting scratch=true or scratch = /my/directory/ instead, which writes the intermediate files there. In an initial discussion, we agreed on using ${TMPDIR:-/tmp}, however I still experienced issues: when testing with scratch = /my/directory/, intermediate files were still written to tmp.

For the process MarkDuplicates the setting is --TMP_DIR = . . I tested the same for BaseRecalibration. This results in:

scratch = true : Intermediate files are written to /scratch
scratch = /my/dir: Intermediate files are written to the directory
scratch = false: Intermediate files are written to a tmp directory within the work-dir

This behaviour appears desirable to me and is somewhat in line with Harshil's proposal to always specify the work directory.

@FriederikeHanssen
Copy link
Contributor Author

@maxulysse tried this again by deleting and re-forking. Hope all is well now with the not overwriting your changes.

@maxulysse
Copy link
Member

This one is perfect.
Thanks a lot

@FriederikeHanssen FriederikeHanssen merged commit c6a4e9d into nf-core:dev Jun 22, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants