-
Notifications
You must be signed in to change notification settings - Fork 145
Conference call notes 20230830
Kenneth Hoste edited this page Sep 12, 2023
·
5 revisions
(back to Conference calls)
Notes on the 228th EasyBuild conference call, Wednesday 30 Aug 2023 (15:00 UTC)
List of attendees (11):
- Kenneth Hoste (HPC-UGent, Belgium)
- Simon Branford (Univ. of Birmingham, UK)
- Alexander Grund (TU Dresden, Germany)
- Thomas Hayward-Schneider (Max Planck Institute for Plasma Physics, Germany)
- Thomas Hoffman (EMBL, Heidelberg, Germany)
- Adam Huffman (Adam Huffman (Big Data Institute, Oxford, UK)
- Sam Moors (Vrije Universiteit Brussel, Belgium)
- Sebastien Moretti (SIB, Switzerland)
- Mikael Öhman (Chalmers University of Technology, Sweden)
- Bart Oldeman (Digital Research Alliance of Canada)
- Jure Pečar (EMBL, Germany)
- overview of recent developments
- Q&A
- latest EasyBuild release: 4.8.0 (7 July 2023)
- ETA for next EasyBuild release: ASAP
- recent changes
-
docs (merged PRs)
- ...
-
framework (merged PRs)
-
bug fixes
- don't use
FileExistsError
inmkdir
function (doesn't exist in Python 2.7) (PR #4328)
- don't use
-
enhancements
- add end-to-end test for running EasyBuild in different Linux distros using containers (PR #3968)
- add
--silence-hook-trigger
configuration option to supress printing of debug message every time a hook is triggered (PR #4329) - add definitions for ifbf and iofbf toolchain (PR #4337)
- add support for using fine grained Github tokens (PR #4332)
- add support for submodule filtering and specifying extra Git configuration in
git_config
(PR #4338)
-
changes
- ...
-
EasyBuild 5.0 (to
5.0.x
branch)- implement support in
run
function for running command in different working directory + switch to run function infiletools
(PR #4327) - sync
5.0.x
branch withdevelop
after introduction ofrun_shell_cmd
hook inrun_cmd
(cfr. PR #4323) - trigger
run_shell_cmd
hook inrun
function (PR #4334) - rename
run
function torun_shell_cmd
(PR #4335 + PR #4336)
- implement support in
-
bug fixes
-
easyblocks (merged PRs)
-
bug fixes
- fix typo in TensorFlow easyblock when finding libdir of OpenSSL (PR #2989)
-
enhancements
- improve cpu-arch optimization settings for OpenCV (PR #2954)
- enhance
PythonPackage
easyblock to deal withposix_local
installation scheme used by Python in recent Debian/Ubuntu versions (PR #2977 + PR #2978)- fixes issue #2976: Python packages are being installed to
local/lib/python*/dist-packages
due to tweaks tosysconfig.py
in OS (Ubuntu 22.04)
- fixes issue #2976: Python packages are being installed to
- enhance PyTorch easyblock to print individual failed tests (PR #2983)
-
updates
- update MXNet easyblock + don't try to install R extension by default for MXNet >= 1.0 (PR #2955)
-
changes
- ...
- new easyblocks
- ...
-
EasyBuild 5.0 (to
5.0.x
branch)- ...
-
bug fixes
-
easyconfigs (merged PRs)
- ~100 easyconfig PRs were merged since last conf call
-
bug fixes
- remove superflous dependencies from Horovod easyconfig on top of PyTorch (PR #18262)
- add patches to fix PyTorch 1.12 (CPU-only) w/ foss/2022a on POWER (PR #18490)
- add alternative checksum for Extrae v4.0.4 (PR #18564)
- add patches to fix PyTorch-1.12.1 w/
foss/2021a
+ CUDA v11.3.1 on POWER (PR #18492) - add patches to fix PyTorch-1.12.1 w/
foss/2021b
+ CUDA v11.5.2 on POWER (PR #18493) - add patches to fix PyTorch-1.12.1 w/
foss/2022a
+ CUDA v11.7.0 on POWER (PR #18494) - switch to
CargoPythonPackage
in maturin easyconfig (PR #18596) - fix sanity check for ccache by setting
LC_ALL=C
(PR #18677) - make Autoconf a build dep for tRNAscan-SE + add missing Perl dependency (PR #18680)
-
enhancements
- add RnBeads extensions to R-bundle-Bioconductor v3.16 (PR #18682)
- (noteworthy) new software
- noteworthy software updates
- changes
-
docs (open PRs + issues)
- project board to perform yearly review cycle of all documentation pages: https://github.com/orgs/easybuilders/projects/17/views/1
- ...
-
framework (open PRs + issues)
- reported bugs / bug fixes
-
enhancements
- add CI workflow to run unit tests with Python 2 (again) (PR #4333)
- needs more work due to handful of tests failing in a weird way (incl. due to genuine bugs in Python 2.7), should maybe use Ubuntu 20.04 rather than CentOS 7.9 which is dead and buried...
- add CI workflow to run unit tests with Python 2 (again) (PR #4333)
-
changes
- ...
-
EasyBuild 5.0 (to
5.0.x
branch)- improved error reporting by
run_shell_cmd
function (now just raisessubprocess.CalledProcessError
) - should
shell
option forrun_shell_cmd
function be renamed touse_bash
?
- improved error reporting by
-
easyblocks (open PRs + issues)
- bug reports/fixes
-
RPackage
easyblock is not compatible with--sanity-check-only
(issue #2986)
-
- enhancements
-
updates
- update CP2K easyblock to use
do_regtest.py
script for recent versions (WIP PR #2984) - update TensorFlow easyblock for v2.13 since LMDB is no longer a dependency (PR #2982)
- update CP2K easyblock to use
- new easyblocks
-
changes
- ...
-
EasyBuild 5.0 (to
5.0.x
branch)- ...
- bug reports/fixes
-
easyconfigs (open PRs + issues)
- bug fixes/reports
- enhancements
-
new software
- tensorflow-compression (PR #18676)
-
noteworthy software updates
- AlphaPulldown v0.30.7 w/
foss/2022a
(PR #18506) - GTK3 v3.24.37 w/
GCCcore/12.3.0
(PR #18595) -
intel/2023.07
(PR #18439) - PETSc 3.19.4 w/
foss/2023a
(PR #18608) - PyTorch v1.13.1 w/
foss/2022a
+ CUDA 11.7.0 (PR #18424 - PyTorch v1.13.1 w/
foss/2022b
(PR #18421) - Qt6 v6.5.2 (PR #18683)
- TensorFlow v2.13.0 w/
foss/2022a
(PR #18644)
- AlphaPulldown v0.30.7 w/
- changes
- ...
-
docs (merged PRs)
-
2023b
update of common toolchains- most likely using GCC 13.2 as a base
- need to check whether classic Intel Fortran compiler 2023.2.1 is compatible with GCC 13.2 (relevant for libstdc++, etc.)
- start archiving easyconfigs using oldest toolchain before EasyBuild 5.0?
- cfr. policy being added to docs in https://github.com/easybuilders/easybuild-docs/pull/200