Skip to content

Azure meeting 11 Jan 2022

Jump to bottom
Kenneth Hoste edited this page Jan 11, 2022 · 1 revision

EESSI/Azure/SURF sync meeting 2022-01-11

Agenda

  • overview of spent credits
  • brief report on EESSI hackathon (Dec'21)
  • adding WRF to 2021.12 EESSI pilot (request by Hugo)
  • adding support for Azure to Cluster-in-the-Cloud (Hugo)

Attendees

  • Kenneth Hoste (HPC-UGent)
  • Martin Brandt (SURF)
  • Laura Redfern (MS Azure)
  • Ivar Janmaat (SURF)
  • Alan O'Cais (CECAM)
  • Henk-Jan Zilverberg (Univ. of Groningen)
  • Hugo Meiland (MS Azure)
  • Bob Dröge (Univ. of Groningen)
  • Julian Kreuk (MS Azure)

Notes

Overview of spent credits

Month Spent credits
Sep 2021 €181.79
Oct 2021 €548.86
Nov 2021 €344.85
Dec 2021 €199.26
Jan 2022 €63.81
Total €1,338.56

Use cases:

  • Stratum-1: ~€700

    • mirror server for EESSI
    • hosted in Azure us-east

  • GitHub runners: ~€415

    • mainly used for building container images (client access, controlled build node environment)
    • now powered off + hibernated (not needed for now)

  • build node(s): ~€140

    • mainly for software layer optimized for AMD Milan (x86_64/amd/zen3)
    • also for testing bootstrap of 2021.12 compat layer

  • end date?

    • end of fiscal year or not?
    • credits were passed on to SURF, so no end date

Brief report on EESSI hackathon (Dec'21)

Adding WRF to 2021.12 EESSI pilot

Adding support for Azure to Cluster-in-the-Cloud

  • Hugo got Azure support in CitC working
  • auto-scaling of nodes as jobs appear is working
  • current focus is on getting IB support working
    • use of availability sets is already working
    • MPI through EESSI not working yet
  • pull requests have been opened to CitC ansible/terraform repos
    • progress is unclear
    • bots testing the PRs need Azure access
    • need to get feedback from Matt (main developer)
    • dedicated sponsorship for Matt for long-term Azure support in CitC
Clone this wiki locally