Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ESPResSo easyconfig template with software-commit #1

Merged
merged 7 commits into from
Oct 10, 2024

Conversation

Neves-P
Copy link
Member

@Neves-P Neves-P commented Sep 18, 2024

This adds a template easyconfig file and associated easystack file to build ESPReSso given a specific commit hash. In the easystackfile this hash is specified as an option software-commit.

I put the easystack in a subdirectory inside the espresso directory, but this can be moved somewhere else if that's better.

@ocaisa
Copy link
Member

ocaisa commented Sep 18, 2024

Anything that works is good for me, we may want to add a directory that gets searched automatically for additional easyconfigs (EASYBUILD_ROBOT=/path/to/devel/easyconfigs)

@Neves-P
Copy link
Member Author

Neves-P commented Sep 18, 2024

That's a good idea, it'll probably come in handy for installing new dependencies.

One other thing I just realised is that we may want to think about a naming convention for the easyconfigs. In this case we are building 4.2.2, but if we were to build from what's in main it would be something like 4.3-dev, so maybe we want to reflect that in the file name. On the other hand, we could remove the version number entirely since the commit is what matters. If this has no other implications then maybe it should be left for the developers to decide.

@Neves-P
Copy link
Member Author

Neves-P commented Sep 18, 2024

Build works locally for this commit 👍

@boegel
Copy link
Contributor

boegel commented Sep 18, 2024

Filename doesn't matter much for this experiment, looks good to me.

Next steps are:
i) setting up the bot for EESSI (with the changes implemented in EESSI/eessi-bot-software-layer#283 active);
ii) working on the bot build job script to figure out how this can be picked up to actually build something and produce a tarball for it;

@Neves-P
Copy link
Member Author

Neves-P commented Sep 24, 2024

bot: build

1 similar comment
@Neves-P
Copy link
Member Author

Neves-P commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen4 for repository dev.eessi.io-2024.09 in job dir /project/def-users/SHARED/jobs/2024.09/pr_1/3

date job status comment
Sep 24 08:13:37 UTC 2024 submitted job id 3 awaits release by job manager
Sep 24 08:14:16 UTC 2024 released job awaits launch by Slurm scheduler
Sep 24 10:17:31 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job3.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Sep 24 10:17:31 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job3.test does not exist in job directory or reading it failed.

@Neves-P
Copy link
Member Author

Neves-P commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen4 for repository dev.eessi.io-2024.09 in job dir /project/def-users/SHARED/jobs/2024.09/pr_1/4

date job status comment
Sep 24 08:36:08 UTC 2024 submitted job id 4 awaits release by job manager
Sep 24 08:36:21 UTC 2024 released job awaits launch by Slurm scheduler
Sep 24 10:17:33 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job4.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Sep 24 10:17:33 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job4.test does not exist in job directory or reading it failed.

@boegel
Copy link
Contributor

boegel commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io-2023.06 in job dir /project/def-users/SHARED/jobs/2024.09/pr_1/8

date job status comment
Sep 24 17:57:45 UTC 2024 submitted job id 8 awaits release by job manager
Sep 24 17:58:38 UTC 2024 released job awaits launch by Slurm scheduler
Sep 24 17:59:39 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job8.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Sep 24 17:59:39 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job8.test does not exist in job directory or reading it failed.

@boegel
Copy link
Contributor

boegel commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)
  • received bot command build from boegel
    • expanded format: build

@boegel
Copy link
Contributor

boegel commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)
  • received bot command build from boegel
    • expanded format: build

@boegel
Copy link
Contributor

boegel commented Sep 24, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 24, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io-2023.06 in job dir /project/def-users/SHARED/jobs/2024.09/pr_1/9

date job status comment
Sep 24 18:26:16 UTC 2024 submitted job id 9 awaits release by job manager
Sep 24 18:26:45 UTC 2024 released job awaits launch by Slurm scheduler
Sep 24 18:27:47 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job9.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Sep 24 18:27:47 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job9.test does not exist in job directory or reading it failed.

@Neves-P
Copy link
Member Author

Neves-P commented Sep 25, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 25, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 25, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 25, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Sep 25, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 8, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 8, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io in job dir /project/def-users/SHARED/jobs/2024.10/pr_1/79

date job status comment
Oct 08 07:29:51 UTC 2024 submitted job id 79 awaits release by job manager
Oct 08 07:30:23 UTC 2024 released job awaits launch by Slurm scheduler
Oct 08 07:34:29 UTC 2024 running job 79 is running
Oct 08 08:00:19 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-79.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1728374312.tar.gzsize: 4 MiB (4366635 bytes)
entries: 88
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Oct 08 08:00:19 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job79.test does not exist in job directory or reading it failed.

@Neves-P
Copy link
Member Author

Neves-P commented Oct 9, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 9, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 9, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io in job dir /project/def-users/SHARED/jobs/2024.10/pr_1/81

date job status comment
Oct 09 07:18:23 UTC 2024 submitted job id 81 awaits release by job manager
Oct 09 07:18:31 UTC 2024 released job awaits launch by Slurm scheduler
Oct 09 07:23:37 UTC 2024 running job 81 is running
Oct 09 07:48:12 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-81.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1728460035.tar.gzsize: 4 MiB (4368022 bytes)
entries: 88
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Oct 09 07:48:12 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job81.test does not exist in job directory or reading it failed.
Oct 09 13:00:27 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728460035.tar.gz to S3 bucket failed (no bucket specified for dev.eessi.io)
Oct 09 14:13:13 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728460035.tar.gz to S3 bucket failed (no bucket specified for dev.eessi.io)

@Neves-P Neves-P added bot:deploy Ask bot to deploy missing software installations to dev.eessi.io and removed bot:deploy Ask bot to deploy missing software installations to dev.eessi.io labels Oct 9, 2024
@Neves-P
Copy link
Member Author

Neves-P commented Oct 9, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 9, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 9, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io in job dir /project/def-users/SHARED/jobs/2024.10/pr_1/82

date job status comment
Oct 09 14:24:29 UTC 2024 submitted job id 82 awaits release by job manager
Oct 09 14:24:55 UTC 2024 released job awaits launch by Slurm scheduler
Oct 09 14:31:01 UTC 2024 running job 82 is running
Oct 09 15:18:18 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-82.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gzsize: 4 MiB (4367621 bytes)
entries: 88
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Oct 09 15:18:18 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job82.test does not exist in job directory or reading it failed.
Oct 09 15:19:45 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gz to S3 bucket failed
Oct 10 09:00:09 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gz to S3 bucket failed
Oct 10 09:29:19 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gz to S3 bucket failed
Oct 10 09:52:17 UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gz to S3 bucket failed
Oct 10 10:34:31 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1728487022.tar.gz to S3 bucket succeeded

@Neves-P Neves-P added bot:deploy Ask bot to deploy missing software installations to dev.eessi.io and removed bot:deploy Ask bot to deploy missing software installations to dev.eessi.io labels Oct 9, 2024
@Neves-P
Copy link
Member Author

Neves-P commented Oct 10, 2024

bot: build

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 10, 2024

Updates by the bot instance dev.eessi.io-bot-mc-azure (click for details)

@dev-eessi-io-bot
Copy link

dev-eessi-io-bot bot commented Oct 10, 2024

New job on instance dev.eessi.io-bot-mc-azure for architecture x86_64-amd-zen2 for repository dev.eessi.io in job dir /project/def-users/SHARED/jobs/2024.10/pr_1/83

date job status comment
Oct 10 11:24:50 UTC 2024 submitted job id 83 awaits release by job manager
Oct 10 11:25:06 UTC 2024 released job awaits launch by Slurm scheduler
Oct 10 11:29:12 UTC 2024 running job 83 is running
Oct 10 11:54:56 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-83.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1728561191.tar.gzsize: 4 MiB (4368070 bytes)
entries: 88
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
ESPResSo/4.2.2-foss-2023a-2ba17de6096933275abec0550981d9122e4e5f28
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/SitePackage.lua
.lmod/lmodrc.lua
Oct 10 11:54:56 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job83.test does not exist in job directory or reading it failed.

@boegel
Copy link
Contributor

boegel commented Oct 10, 2024

@Neves-P As discussed, we should try and get those builds done under a test project, adding an extra level to the directory hierarchy?

@Neves-P
Copy link
Member Author

Neves-P commented Oct 10, 2024

@Neves-P As discussed, we should try and get those builds done under a test project, adding an extra level to the directory hierarchy?

Agreed! I will merge this PR since we just ingested the installation as is, which we can then manually remove from the s0.

1st one is done! 🥳

@Neves-P Neves-P merged commit 9e2eb85 into EESSI:main Oct 10, 2024
@dev-eessi-io-bot
Copy link

PR merged! Moved ['/project/def-users/SHARED/jobs/2024.09/pr_1/2', '/project/def-users/SHARED/jobs/2024.09/pr_1/3', '/project/def-users/SHARED/jobs/2024.09/pr_1/4', '/project/def-users/SHARED/jobs/2024.09/pr_1/8', '/project/def-users/SHARED/jobs/2024.09/pr_1/9', '/project/def-users/SHARED/jobs/2024.09/pr_1/10', '/project/def-users/SHARED/jobs/2024.09/pr_1/11', '/project/def-users/SHARED/jobs/2024.09/pr_1/13', '/project/def-users/SHARED/jobs/2024.09/pr_1/12', '/project/def-users/SHARED/jobs/2024.09/pr_1/14', '/project/def-users/SHARED/jobs/2024.09/pr_1/15', '/project/def-users/SHARED/jobs/2024.09/pr_1/16', '/project/def-users/SHARED/jobs/2024.09/pr_1/17', '/project/def-users/SHARED/jobs/2024.09/pr_1/18', '/project/def-users/SHARED/jobs/2024.09/pr_1/19', '/project/def-users/SHARED/jobs/2024.09/pr_1/20', '/project/def-users/SHARED/jobs/2024.09/pr_1/21', '/project/def-users/SHARED/jobs/2024.09/pr_1/22', '/project/def-users/SHARED/jobs/2024.09/pr_1/23', '/project/def-users/SHARED/jobs/2024.09/pr_1/24', '/project/def-users/SHARED/jobs/2024.09/pr_1/25', '/project/def-users/SHARED/jobs/2024.09/pr_1/26', '/project/def-users/SHARED/jobs/2024.09/pr_1/27', '/project/def-users/SHARED/jobs/2024.09/pr_1/28', '/project/def-users/SHARED/jobs/2024.09/pr_1/29', '/project/def-users/SHARED/jobs/2024.09/pr_1/30', '/project/def-users/SHARED/jobs/2024.09/pr_1/31', '/project/def-users/SHARED/jobs/2024.09/pr_1/32', '/project/def-users/SHARED/jobs/2024.09/pr_1/33', '/project/def-users/SHARED/jobs/2024.09/pr_1/34', '/project/def-users/SHARED/jobs/2024.09/pr_1/35', '/project/def-users/SHARED/jobs/2024.09/pr_1/36', '/project/def-users/SHARED/jobs/2024.09/pr_1/37', '/project/def-users/SHARED/jobs/2024.09/pr_1/38', '/project/def-users/SHARED/jobs/2024.09/pr_1/39', '/project/def-users/SHARED/jobs/2024.09/pr_1/40', '/project/def-users/SHARED/jobs/2024.09/pr_1/41', '/project/def-users/SHARED/jobs/2024.09/pr_1/42', '/project/def-users/SHARED/jobs/2024.09/pr_1/43', '/project/def-users/SHARED/jobs/2024.09/pr_1/44', '/project/def-users/SHARED/jobs/2024.09/pr_1/45', '/project/def-users/SHARED/jobs/2024.09/pr_1/46', '/project/def-users/SHARED/jobs/2024.09/pr_1/47', '/project/def-users/SHARED/jobs/2024.09/pr_1/48', '/project/def-users/SHARED/jobs/2024.10/pr_1/49', '/project/def-users/SHARED/jobs/2024.10/pr_1/50', '/project/def-users/SHARED/jobs/2024.10/pr_1/51', '/project/def-users/SHARED/jobs/2024.10/pr_1/52', '/project/def-users/SHARED/jobs/2024.10/pr_1/53', '/project/def-users/SHARED/jobs/2024.10/pr_1/54', '/project/def-users/SHARED/jobs/2024.10/pr_1/55', '/project/def-users/SHARED/jobs/2024.10/pr_1/56', '/project/def-users/SHARED/jobs/2024.10/pr_1/57', '/project/def-users/SHARED/jobs/2024.10/pr_1/58', '/project/def-users/SHARED/jobs/2024.10/pr_1/59', '/project/def-users/SHARED/jobs/2024.10/pr_1/60', '/project/def-users/SHARED/jobs/2024.10/pr_1/61', '/project/def-users/SHARED/jobs/2024.10/pr_1/62', '/project/def-users/SHARED/jobs/2024.10/pr_1/63', '/project/def-users/SHARED/jobs/2024.10/pr_1/64', '/project/def-users/SHARED/jobs/2024.10/pr_1/65', '/project/def-users/SHARED/jobs/2024.10/pr_1/66', '/project/def-users/SHARED/jobs/2024.10/pr_1/67', '/project/def-users/SHARED/jobs/2024.10/pr_1/68', '/project/def-users/SHARED/jobs/2024.10/pr_1/69', '/project/def-users/SHARED/jobs/2024.10/pr_1/70', '/project/def-users/SHARED/jobs/2024.10/pr_1/71', '/project/def-users/SHARED/jobs/2024.10/pr_1/72', '/project/def-users/SHARED/jobs/2024.10/pr_1/73', '/project/def-users/SHARED/jobs/2024.10/pr_1/74', '/project/def-users/SHARED/jobs/2024.10/pr_1/75', '/project/def-users/SHARED/jobs/2024.10/pr_1/77', '/project/def-users/SHARED/jobs/2024.10/pr_1/79', '/project/def-users/SHARED/jobs/2024.10/pr_1/81', '/project/def-users/SHARED/jobs/2024.10/pr_1/82', '/project/def-users/SHARED/jobs/2024.10/pr_1/83'] to $HOME/trash_bin/EESSI/dev.eessi.io/2024.10.10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants