Skip to content

EESSI hackathon Dec'22

Jump to bottom
Kenneth Hoste edited this page Jan 5, 2023 · 4 revisions

EESSI hackathon (Dec'22)

  • when: 14-21 Dec 2022
  • main goal: focused effort on various tasks in EESSI
  • expectations:
    • joining kickoff/sync/show&tell meetings
    • spending a couple of hours that week on one or more of the outlined tasks (in group)
    • take extensive notes (to integrate into documentation later)
  • https://github.com/EESSI/hackathons/tree/main/2022-12
  • show & tell meeting:
    • slides: (no slides)
    • recording: (no recording)

Links

Planned meetings

  • Wed 14 Dec 2022, 09:00 UTC: kickoff

    • clarify expectations
    • overview of tasks
    • getting organised: who works on what, form groups

  • Mon 19 Dec 2022, 09:00 UTC: sync

    • quick progress report per group
    • briefly discuss next steps

  • Wed 21 Dec 2022, 13:00 UTC: show & tell

    • each group briefly demos/presents what they worked on
    • outline follow-up steps

Resources

NC (Standard_NC6) -> Haswell
*** NCv2 (Standard_NC6s_v2) -> Broadwell
*** HC  (Standard_HC44rs)-> Skylake
Dv5 (Standard_D4_v5) -> Ice Lake
*** HBv2 (Standard_HB120rs_v2) -> Rome
HBv3 -> Milan-X
*** HBv4 -> Genoa (Genoa-X when in GA)

Availability

  • Kenneth
    • out-of-office most of Fri 16 Dec
    • out-of-office Mon 19 Dec pm
  • Alan
    • ...
  • Thomas
    • 14: 10-14, 15: 10-16 (16-17 XALT monthly), 16: 9-15, 19: 9-10, 12:30-15, 20: 9-15, 21: 9-10, 12:30-15
    • evenings / weekend
  • Bob
    • afk on Wed 14 Dec
  • Jure
    • ...
  • Sebastien
    • may have some time on Thursday without network in the morning
    • several meetings along the day on Friday 16 Dec
    • not available on Monday between 10:00 and 13:30
    • out-of-office on Wed 21 Dec
  • Hugo
    • oof on Friday 16 Dec
  • Michael
    • ...

Tasks

(see also https://terminplaner4.dfn.de/jNOHCCL2nNTEzrWn)

Adding software to EESSI

Testing/developing build-and-deploy bot

Testing GPU support

Software testing with ReFrame

Streamlining security updates in compat layer

Export sw stack script

  • joining: Jure
    • goals:
      • apptainer support
      • inclusion into eessi (contrib folder? compat layer?)
      • probably in scripts/ dir in filesystem-layer repo?
    • Interesting work by CSC on containerizing software installations
    • CVMFS has a utility to squashfs

Something else

  • joining: Jure
  • maybe: Alan, Hugo, Michael, Bob
  • notes:
    • goals:
      • (Jure) script to export software stack to container
      • (Bob) data repository

Sync meeting 2022-12-19

  • joining: Jure, Thomas, Michael, Kenneth
  • excused: Alan, Sebastién

Adding software to EESSI

Testing/developing build-and-deploy bot

Testing GPU support

Software testing with ReFrame

  • ...

Streamlining security updates in compat layer

  • (no action yet)

Export sw stack script

  • see https://github.com/EESSI/hackathons/tree/16_export_software_stack/2022-12
  • singularity and apptainer don't want to coexist (at least as packaged by epel)
    • because apptainer also ships 'singularity' command (and more stuff)
  • apptainer rpm package is aliased to singularity to create additional fun
    • uninstalling singularity also uninstalls apptainer
  • apptainer is mostly a drop-in replacement for singulairty
  • added some logic to create From: stanza in image definition based on the host distro
    • used to be rocky:linux now rockylinux:...
    • tested on alma/centos/debian/rhel/rocky/ubuntu
  • current state of script: ready to contribute to EESSI/filesystem-layer

Show & tell meeting 2022-12-21

  • joining: Thomas, Michael, Kenneth, Jörg
  • excused: ...

Adding software to EESSI

Testing/developing build-and-deploy bot

Testing GPU support

Software testing with ReFrame

Streamlining security updates in compat layer

  • (no progress here... :( )

Export sw stack script

  • same state as on Monday

Other

  • new compat layer

    • building new version of compat layer currently still requires root for some things
    • blocker for being able to let bot build compat layer
    • could be fixed by
      • not using Ansible anymore, just use a script instead
      • running Ansible in container instead

  • (Bob)

  • (Thomas)

    • should we also look into providing documentation for the software we provide?

  • (Jörg)

    • would be interesting to have a way of submitting installation requests (for things already supported in EasyBuild)
    • bot could automatically test whether it works in EESSI
      • only for trusted contributors
      • only one some platforms (bot could be configured to run test builds of "untested" PRs)
    • requirement could be to provide a script to test the software (to add to test suite, docs, ...)
    • bot could automatically report which installations are missing when a PR is opened
Clone this wiki locally