[develop] Replace shell-based WE2E scripts with python versions#637

Merged

MichaelLueken merged 52 commits intoufs-community:developfrom mkavulich:feature/replace_sh_WE2E_script

Mar 20, 2023

+1,151-4,293

Commits on Mar 6, 2023

Fix error introduced to pythonized WE2E script
mkavulich
committed
Fix failing "specify_template_filenames" test
mkavulich
committed
Add logic and instructions for neatly interrupting and resuming the monitor script
mkavulich
committed
Consolidate check_task_get_extrn_ics and check_task_get_extrn_lbcs into a single function: check_task_get_extrn_bcs
mkavulich
committed
Remove some unnecessary debug prints
mkavulich
committed
Initial version of job summary script
mkavulich
committed
Update experiment yamls to track task cores and walltime, update job_monitor to report core hours
mkavulich
committed
Print summary once all jobs are finished monitoring, add failsafe core hour calculation for missing NNODES variables, clean up formatting
mkavulich
committed
Move some functions into a new utils.py file to avoid circular dependencies
mkavulich
committed
Send rocotorun output to logging.debug, append logs rather than overwriting
mkavulich
committed
Add ability to update experiments in parallel
mkavulich
committed
Remove duplicate routine, add totals row to job summary
mkavulich
committed
More improvements
mkavulich
committed
Add final missing options:
mkavulich
committed
- Remove incorrectly left-in exit call
mkavulich
committed
New way of specifying relative time tests without system calls to date, courtesy of Christina Holt
mkavulich
committed
Some needed changes to address problems with parallel mode
mkavulich
committed
Add a final check using rocotostat to ensure that there are no un-submitted tasks remaining
mkavulich
committed
Fix logic for jobs in DEAD or UNKNOWN status, add logic for "FAILED" jobs, fix incorrect variable in error message
mkavulich
committed
Remove UNKNOWN from the status check; according to rocoto source code, UNKNOWN jobs will be retried, so we don't want to mark these as ERROR
mkavulich
committed
Some more fixes from final testing
mkavulich
committed
Start updating documentation
mkavulich
committed
Finish implementation of "print_test_details()"
mkavulich
committed
For test details, rename everything to be more consistent with old
mkavulich
committed
Continue updating documentation through first few sections of WE2E chapter
mkavulich
committed
Some more documentation updates
mkavulich
committed
Update gitignore for new/updated filenames
mkavulich
committed
Documentation for WE2E_summary.py script
mkavulich
committed
Revert behavior of rocotorun to only capture output if debug=True. This
mkavulich
committed
Fixes suggested by pylint
mkavulich
committed
The big moment: ditching the old shell version.
mkavulich
committed
Updates to Jenkins test script for new python workflow
mkavulich
committed
Fix unit test for new behavior of calculate_cost.py
mkavulich
committed
Fix unit test for real this time?
mkavulich
committed
Don't call rocotorun for WE2E_summary
mkavulich
committed

Commits on Mar 8, 2023

Commits on Mar 10, 2023