Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test bot PR172 with current EESSI pilot (2021.12) #65

Open
wants to merge 73 commits into
base: main
Choose a base branch
from
Open

Test bot PR172 with current EESSI pilot (2021.12) #65

wants to merge 73 commits into from

Conversation

poksumdo
Copy link
Collaborator

  • just adds an echo to EESSI-pilot-install-software.sh

truib and others added 30 commits January 24, 2023 21:59
@truib
added a function to obtain full path to a tool
447bb2d
@truib
partial bot/build.sh for eessi_container.sh
e2c24cf
@truib
added function to determine IPv4 address
a71f8e4
@truib
various updates for bot/build.sh and eessi_container.sh
b5bf008
@truib
provide CVMFS_HTTP_PROXY if necessary
b5c07ee
@truib
add functions to derive hostname and port number from proxy URL
4ff3721
@truib
add function to determine config sections
7a58fbf
@truib
add parameter to list repositories, fix bugs
a5ea7d8 
fixed bugs

- determining IP address for proxy host was wrong
- handling of positional parameters for executing commands with arguments was wrong
@truib
fix bash pattern matching operator
6ed3d85
@truib
various updates to bot/build.sh
fd5cc3d 
- added handling of HTTPS_PROXY
- moved CONTAINER setting from site_config to repository section (different
  repositories could require different containers)
- added handling of CPU_TARGET and EESSI_SOFTWARE_SUBDIR_OVERRIDE
- updated TODOs
- added setting of EESSI_REPOS_CFG_FILE_OVERRIDE
- bug fixes
@truib
Merge branch 'enhancement/bot-build-with-swl-216' of github-trz:trz42…
234bab3 
…/software-layer into enhancement/bot-build-with-swl-216
@truib
replace FILE with DIR in EESSI_REPOS_CFG_FILE_OVERRIDE
b2eab08
@truib
Merge branch 'main' of github-trz:eessi/software-layer into enhanceme…
7663fbc 
…nt/bot-build-with-swl-216
@truib
fix whitespace issues
7e200a1
@truib
fix handling of HTTP(S)_PROXY settings
57b6f27
@truib
include changes made to test PR for building with the bot
fce504f
@trz42
Merge branch 'nessi.no-2022.11-dev' into enhancement/bot-build-with-s…
910d079 
…wl-216
@trz42
Merge branch 'update_for_eessi_container_sh' of github-trz:trz42/soft…
7c418cd 
…ware-layer into enhancement/bot-build-with-eessi-container
@trz42
improvements to resuming job environment
712c40e 
cherry-picked via 23e773c
Note only applied part for bot/build.sh
@trz42
improved handling of container cache + explicit pull of image
16d9857 
cherry-picked via bfb1b29
Note, only applied part for bot/build.sh
@trz42
changed --info -> --verbose
9e8ca62
@trz42
improved messages for resume info and adjusted parsing in bot/build.sh
c0350a9
@trz42
delete one of two tmp storage tarballs created by bot/build.sh
ef9a552
@trz42
Merge branch 'main' of github-trz:EESSI/software-layer into enhanceme…
1c0081d 
…nt/bot-build-with-eessi-container
@trz42
support cmd line arg flag terminator
7cc6575
@trz42
just print contents of cfg/job.cfg
0def4e9
@trz42
switching from json (YQ) to ini (cfg_files.sh)
ef608d1
@trz42
add --generic arg when running install script
429d5a0
@trz42
fix error in regex
bd31faa
@trz42
use command separator --
1bafb78
@poksumdo
Copy link
Collaborator Author

final tests after fixing failing pytests in EESSI/eessi-bot-software-layer#172

bot: help (should not result in anything because poksumdo was removed from list of accounts who can send commands to the devel instance)

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • parsing the bot command help (should not result in anything because poksumdo was removed from list of accounts who can send commands to the devel instance), received from sender poksumdo, failed

@poksumdo
Copy link
Collaborator Author

bot: help

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 31, 2023 •
edited
Loading

Updates by the bot instance CitC-commander (click for details)

  • received bot command help from poksumdo

    • expanded format: help

  • handling command help resulted in:
    How to send commands to bot instances

    • Commands must be sent with a new comment (edits of existing comments are ignored).
    • A comment may contain multiple commands, one per line.
    • Every command begins at the start of a line and has the syntax bot: COMMAND [ARGUMENTS]*
    • Currently supported COMMANDs are: help, build, show_config

@poksumdo
Copy link
Collaborator Author

Did remove build permission for account poksumdo, hence, it could still send commands. Changed now. Repeating test.

bot: help

@poksumdo
Copy link
Collaborator Author

Above command didn't produce any updates here (the log was showing a note). We should also create a note here. Added that. Repeating test.

bot: help

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account poksumdo has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

8 similar comments
@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account eessi-bot-devel-trz42[bot] has NO permission to send commands to the bot

@poksumdo
Copy link
Collaborator Author

Nice. Endless loop ... stopped. Made an attempt to not let the bot create comments on comments it has created self.

bot: help

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account poksumdo has NO permission to send commands to the bot

@poksumdo
Copy link
Collaborator Author

bot: show_config

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • account poksumdo has NO permission to send commands to the bot

@trz42
Copy link
Owner

trz42 commented May 31, 2023

Let an account with command_permission send a command.

bot: help

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 31, 2023 •
edited
Loading

Updates by the bot instance CitC-commander (click for details)

  • received bot command help from trz42

    • expanded format: help

  • handling command help resulted in:
    How to send commands to bot instances

    • Commands must be sent with a new comment (edits of existing comments are ignored).
    • A comment may contain multiple commands, one per line.
    • Every command begins at the start of a line and has the syntax bot: COMMAND [ARGUMENTS]*
    • Currently supported COMMANDs are: help, build, show_config

@trz42
Copy link
Owner

trz42 commented May 31, 2023

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 31, 2023 •
edited
Loading

Updates by the bot instance CitC-commander (click for details)

@eessi-bot-devel-trz42
Copy link

Instance CitC-commander is configured to build:

  • arch x86_64/generic for repo nessi.no-2022.11
  • arch x86_64/generic for repo nessi.no-2023.04
  • arch x86_64/generic for repo eessi-2023.04
  • arch x86_64/amd/zen2 for repo nessi.no-2022.11
  • arch x86_64/intel/skylake_avx512 for repo nessi.no-2022.11
  • arch x86_64/intel/cascadelake for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2023.04
  • arch aarch64/generic for repo eessi-2023.04

@trz42
Copy link
Owner

trz42 commented May 31, 2023

bot: build arch:generic config:large

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance CitC-commander (click for details)
  • parsing the bot command build arch:generic config:large, received from sender trz42, failed

@trz42
Copy link
Owner

trz42 commented May 31, 2023

bot: build arch:aarch64 repo:eessi

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 31, 2023 •
edited
Loading

Updates by the bot instance CitC-commander (click for details)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented May 31, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/PR172/jobs/2023.05/pr_65/4844

date job status comment
May 31 07:32:36 AM UTC 2023 submitted job id 4844 awaits release by job manager
May 31 07:33:00 AM UTC 2023 released job awaits launch by Slurm scheduler
May 31 07:36:03 AM UTC 2023 running job 4844 is running
May 31 07:45:20 AM UTC 2023 finished 😢 FAILURE
  • Found slurm output slurm-4844.out in job dir
  • Slurm output lacks message "No missing modules!".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@poksumdo @trz42 @truib @boegel @ocaisa @bedroge