Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

distribute building of software layer across nodes in a cluster #144

Open
4 tasks
boegel opened this issue Nov 15, 2021 · 1 comment
Open
4 tasks

distribute building of software layer across nodes in a cluster #144

boegel opened this issue Nov 15, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@boegel
Copy link
Contributor

boegel commented Nov 15, 2021

We're currently always using a single node to build the software layer, it would be nice to have support for leveraging a pool of available nodes, which should significantly speed up the process.

TODOs:

  • fully autonomous installation procedure using EESSI build container (incl. running in Gentoo Prefix environment)
  • set up overlay directories in a shared filesystem (?)
    • or use local filesystem and create tarballs per installation, which are expanded as-needed through an EasyBuild hook
  • modify existing of add separate build script
  • add support to EasyBuild to provide a template for a job script to allow building in a container image
@boegel boegel added the enhancement New feature or request label Nov 15, 2021
@amadio
Copy link

amadio commented Nov 16, 2021

Have you looked at using distcc? I never tried it on prefix, I wonder if that would work at least for the compatibility layer.

trz42 pushed a commit to trz42/software-layer that referenced this issue Jun 29, 2023
{23.06}[foss/2022a] CMake + OpenMPI + FFTW.MPI + BLIS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: No status
Development

No branches or pull requests

2 participants