Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

changes to support job-processing cookbook #5490

Merged
merged 4 commits into from
Jan 17, 2024
Merged

Conversation

davidpanderson
Copy link
Contributor

Add Python tools for submitting batches of jobs (sample_submit_batch)
and for assimilating jobs from these batches (sample_assimilate.py).
Extend script_assimilator to supply the data needed by the latter.

- script_assimilator: add batch_id option
- add/fix comments
- demo_submit_batch, sample_assimilate.py: finish
-
script_assimilator:
    in error case, pass WU name, ID, and batch ID
    if verbose, show script cmdline
sample_assimilate.py:
    write to ../sample_results/x
    use batch ID in error case
    show cmdlines if os.system() fails
Copy link

codecov bot commented Jan 17, 2024

Codecov Report

Attention: 41 lines in your changes are missing coverage. Please review.

Comparison is base (95adf93) 10.84% compared to head (e5d138b) 10.84%.
Report is 9 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #5490      +/-   ##
============================================
- Coverage     10.84%   10.84%   -0.01%     
  Complexity     1068     1068              
============================================
  Files           279      279              
  Lines         36158    36160       +2     
  Branches       8356     8357       +1     
============================================
  Hits           3920     3920              
- Misses        31844    31846       +2     
  Partials        394      394              
Files Coverage Δ
sched/script_validator.cpp 0.00% <ø> (ø)
tools/create_work.cpp 0.00% <ø> (ø)
tools/process_input_template.cpp 0.00% <ø> (ø)
sched/script_assimilator.cpp 0.00% <0.00%> (ø)
tools/stage_file_native.cpp 0.00% <0.00%> (ø)

... and 1 file with indirect coverage changes

Copy link
Member

@AenBleidd AenBleidd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please fix one critical typo

if sys.argv[1] == '--error':
error_code = sys.argv[2]
wu_name = sys.argv[3]
wu_id = sys.argv[3]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davidpanderson, here's a typo, I suppose it should be sys.argv[4]

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops!!! Thanks, fixed.

@AenBleidd AenBleidd merged commit fc8a3bc into master Jan 17, 2024
85 of 86 checks passed
@AenBleidd AenBleidd deleted the dpa_submit_demo branch January 17, 2024 12:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants