Hi there! Many thanks for taking an interest in improving nf-core/tools.
If you need help then the best place to ask is the #tools
channel on the nf-core Slack.
You can get an invite on the nf-core website.
If you'd like to write some code for nf-core/tools, the standard workflow is as follows:
- Check that there isn't already an issue about your idea to avoid duplicating work.
- If there isn't one already, please create one so that others know you're working on this
- Fork the nf-core/tools repository to your GitHub account
- Make the necessary changes / additions within your forked repository
- Submit a Pull Request against the
dev
branch and wait for the code to be reviewed and merged.
If you're not used to this workflow with git, you can start with some basic docs from GitHub.
If you want to work with developing the nf-core/tools code, you'll need a couple of extra Python packages.
These are listed in requirements-dev.txt
and can be installed as follows:
pip install --upgrade -r requirements-dev.txt
Then install your local fork of nf-core/tools:
pip install -e .
All Python code in nf-core/tools must be passed through the Ruff code linter and formatter. This ensures a harmonised code formatting style throughout the package, from all contributors.
You can run Ruff on the command line (it's included in requirements-dev.txt
) - eg. to run recursively on the whole repository:
ruff format .
Alternatively, Ruff has integrations for most common editors and VSCode(https://github.com/astral-sh/ruff-vscode) to automatically format code when you hit save.
There is an automated CI check that runs when you open a pull-request to nf-core/tools that will fail if any code does not adhere to Ruff formatting.
Ruff has been adopted for linting and formatting in replacement of Black, isort (for imports) and pyupgrade. It also includes Flake8.
This repository comes with pre-commit hooks for ruff and Prettier. pre-commit automatically runs checks before a commit is committed into the git history. If all checks pass, the commit is made, if files are changed by the pre-commit hooks, the user is informed and has to stage the changes and attempt the commit again.
You can use the pre-commit hooks if you like, but you don't have to. The CI on Github will run the same checks as the tools installed with pre-commit. If the pre-commit checks pass, then the same checks in the CI will pass, too.
You can install the pre-commit hooks into the development environment by running the following command in the root directory of the repository.
pre-commit install --install-hooks
You can also run all pre-commit hooks without making a commit:
pre-commit run --all
We aim to write function docstrings according to the Google Python style-guide. These are used to automatically generate package documentation on the nf-core website using Sphinx. You can find this documentation here: https://nf-co.re/tools/docs/
If you would like to test the documentation, you can install Sphinx locally by following Sphinx's installation instruction.
Once done, you can run make clean
and then make html
in the docs/api
directory of nf-core tools
.
The HTML will then be generated in docs/api/_build/html
.
When you create a pull request with changes, GitHub Actions will run automatic tests. Typically, pull-requests are only fully reviewed when these tests are passing, though of course we can help out before then.
There are two types of tests that run:
The nf-core tools package has a set of unit tests bundled, which can be found in the tests/
directory.
New features should also come with new tests, to keep the test-coverage high (we use codecov.io to check this automatically).
You can try running the tests locally before pushing code using the following command:
pytest --color=yes
nf-core/tools contains both the main nf-core template for pipelines and the code used to test that pipelines adhere to the nf-core guidelines. As these two commonly need to be edited together, we test the creation of a pipeline and then linting using a CI check. This ensures that any changes we make to either the linting or the template stay in sync. You can replicate this process locally with the following commands:
nf-core create -n testpipeline -d "This pipeline is for testing"
nf-core lint nf-core-testpipeline
This repo includes a devcontainer configuration which will create a GitHub Codespaces for Nextflow development! This is an online developer environment that runs in your browser, complete with VSCode and a terminal.
To get started:
- Open the repo in Codespaces
- Tools installed
- nf-core
- Nextflow
Devcontainer specs: