Skip to content

meeting Aug 6th 2020

Jump to bottom
Kenneth Hoste edited this page Aug 10, 2020 · 2 revisions
  • date & time: Thu Aug 6th 2020 - 3pm CEST (1pm UTC)
    • (every first Thursday of the month)
  • venue: (online, see mail for meeting link, or ask in Slack)
  • agenda:
    1. Short introduction by new partners (if any)
    2. Progress report
      • Brainstorm meeting on July 7th
      • Filesystem layer
      • Compatibility layer
      • Software layer
      • Other
    3. Who does what the coming weeks?
    4. Q&A

Slides

Short introduction by new people

  • quick introductions by new people attending the meeting:
    • Robert Schulz (Leiden University, Netherlands)
    • Hong Lee (Radboud University, Netherlands)
    • Daniel Farinha (Dell Technologies)
    • Carlos Fenoy (Roche)
    • Adam Huffman (Big Data Institute, Oxford)

Progress in last month

Brainstorm meeting July 7th (Caspar)

Filesystem layer (Henk-Jan)

  • various small improvements to Ansible playbooks
  • cvfms-config-eessi packages (*.rpm, *.deb) for Linux clients
  • documentation by Jaco on accessing CVMFS pilot repo from Windows (via WSL) and macOS @ http://dell.eessi-hpc.org/
  • evaluation of gateway/publisher setup by Bob
  • (links: see slides)

Compatibility layer (Peter)

  • Gentoo Prefix installation in place in pilot repo /cvmfs/pilot.eessi-hpc.org
    • incl. Lmod
    • TODO: archspec
  • concerns w.r.t. reproducibility of Gentoo Prefix installation
    • Carlos had some ideas w.r.t. making it more reproducible
      • using bootstrap script from CI
    • can we get to an installation which works offline (after pre-fetching requires sources)?

Software layer (Caspar, Kenneth)

  • progress on "driver script" (see https://github.com/EESSI/software-layer/pull/5)
    • script that consumes "build list" (list of software to include in EESSI stack)
    • uses EasyBuild as a library
    • allows filtering based on system aspects (CPU arch, GPU vs CPU-only, etc.)
  • experimenting with installing software with EasyBuild on top of Gentoo Prefix
    • making sure installations don't use anything from host OS is a challenge
    • Caspar followed ComputeCanada approach of "aggressively" filtering dependencies: use binutils from Gentoo Prefix installation
    • Kenneth is trying to get binutils + GCC built with EasyBuild working in Gentoo Prefix environment
    • figuring out which packages should be installed where will need further discussion
      • balance between having control w.r.t. package versions + allowing in-place updates (for security reasons)
  • currently playing around on "generoso" test system (only accessible to EasyBuild maintainers)
    • hopefully will result in installations in pilot stack soon

Other

Who works on what in coming weeks?

  • We should assign "leads" per layer who try and set up smaller meetings with people interested in specific aspects of the project.

Q&A

Clone this wiki locally