This repository is used to develop and document Docker and Singularity containers with various software and analytical tools.
Below is the list of tools included in the different Dockerfiles and installer bash scripts for each container.
Please keep up to date (and update the main <ldpred2>/README.md when pushing new container builds):
| container | OS/tool | version |
|---|---|---|
| ldpred2.sif | ubuntu | 20.04 |
| ldpred2.sif | rocker/verse (R) | 4.2.1 |
| ldpred2.sif | devtools (R) | 2.4.4 |
| ldpred2.sif | bigreadr (R) | 0.2.4 |
| ldpred2.sif | bigsnpr (R) | 1.11.4 |
| ldpred2.sif | data.table (R) | 1.14.2 |
| ldpred2.sif | DescTools (R) | 0.99.46 |
| ldpred2.sif | dplyr (R) | 1.0.10 |
| ldpred2.sif | ggplot2 (R) | 3.3.5 |
| ldpred2.sif | fmsb (R) | 0.7.3 |
| ldpred2.sif | magrittr (R) | 2.0.3 |
| ldpred2.sif | reghelper (R) | 1.1.1 |
| ldpred2.sif | tibble (R) | 3.1.8 |
| ldpred2.sif | tidyr (R) | 1.2.1 |
| ldpred2.sif | gctb | 2.02 |
| ldpred2.sif | PRSice | 2.3.5 |
If you face any issues, or if you need additional software, please let us know by creating an issue.
For convenience, a Makefile is provided in this directory in order to build Singularity containers from Dockerfiles (as <ldpred2/src/dockerfiles/ldpred2/Dockerfile>).
Using this files assumes that a working Docker and Singularity installation, as well as the GNU make utility is available on the host computer/build system.
On Debian-based Linux OS, this utility can usually be installed by issuingapt-get install -y make; on MacOS with Homebrew asbrew install make. Prefixsudo if necessary.
Then, the container can be built by issuing:
make ldpred2.sif
If all went well, the built file should be located as <ldpred2/containers/ldpred2.sif>.
In case super-user (sudo) privileges are required, issue:
sudo make ldpred2.sif
In order to build the container manually, this is possible via the following steps
docker build -t ldpred2 -f dockerfiles/ldpred2/Dockerfile . # build docker container
In case you do not want to use Singularity (e.g., for testing locally), the build can be used e.g., by issuing
docker run -it -p 5001:5001 ldpred2 python --version
which should return the currently installed Python version incorporated into the container.
You may replace the port numbers (5001) by another (e.g., 5000).
To convert, and relocate the Singularity container file generated from the Docker image, issue
bash scripts/convert_docker_image_to_singularity.sh ldpred2 # produces ldpred2.sif
bash scripts/scripts/move_singularity_file.sh.sh ldpred2 # put ldpred2.sif file to <ldpred2>/containers/ directory
Again, super-user (sudo) privileges may be required on the host computer. In that case, prefix sudo on the line(s) that fail.
For further details on the commands within each bash file, open the .sh files in a code editor.
The above steps may leave a collection of images in the Docker registry, wasting drive space. To list them, issue
docker images -a
Chosen images can be removed by issuing:
docker rmi <image-id-1> <image-id-2> ...
For more info, see docker rm
Some basic checks for the functionality of the different container builds are provided in <ldpred2>/tests/, implemented in Python.
The tests can be executed using the Pytest testing framework.
In case singularity is not found in PATH, tests will fall back to docker.
In case docker is not found, no tests will run.
To install Pytest in the current Python environment, issue:
pip install pytest # --user optional
New virtual environment using conda:
conda create -n pytest python=3 pytest -y # creates env "pytest"
conda activate pytest # activates env "pytest"
Then, all checks can be executed by issuing:
cd <ldpred2>
py.test -v tests # with verbose output
Checks for individual containers (e.g., ldpred2.sif) can be executed by issuing:
py.test -v tests/test_ldpred2.py
Note that the proper container files (*.sif files) corresponding to the different test scripts must exist in <ldpred2>/containers/,
not only git LFS pointer files.