Convert forecast-only stage_ic job to python #2650
Assignees
Labels
feature
New feature or request
Comments
|
Will take care of as part of PR for issue #2475. Closing as not needed. |
WalterKolczynski-NOAA
added a commit
that referenced
this issue
Aug 20, 2024
This PR converts the staging job from shell to python and introduces the use of yaml. Changes in this PR: 1. Rename `scripts/exglobal_stage_ic.sh` to `scripts/exglobal_stage_ic.py`. 2. Update `jobs/JGLOBAL_STAGE_IC` to use `.py` script extension. Move `COM*` variable declarations and member loop down into yaml and python respectively. Move `GDATE/gPDY/gcyc` settings up to JJOB from ex-script and replace with newer cycle variables (as done in forecast job). 3. Create `parm/stage` folder to hold newly created `stage.yaml.j2`, which both mimics forecast-only functionality in existing `scripts/exglobal_stage_ic.sh` and adds functionality for cycled mode. 4. Create `ush/python/pygfs/task/stage.py` to house staging job python functions for call from `scripts/exglobal_stage_ic.py`. 5. Remove `stage_ic` job rocoto dependencies from xml. Do not need and removes area of duplicate maintenance. 6. Add cycled staging jobs for gdas and enkf suites. 7. Rename `model_data` to `model` for issue #2686 There will now be distinct `stage_ic` jobs for each `RUN`: `gdasstage_ic`, `gfsstage_ic`, `enkfgdasstage_ic`, `stage_ic` (for gefs). Related work was done to set up new symlink folder structure under supported platform `ICSDIR` folder for use by updated staging job. Resolves #2475 Resolves #2650 Resolves #2686 --------- Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com> Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov> Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What new functionality do you need?
The existing stage_ic job in forecast-only mode needs to be converted from shell to python. This should improve and enhance the job capabilities and make it more extensible.
This is a subtask of issue #2475.
What are the requirements for the new functionality?
Existing job functionality should be retained but converted to python and yaml.
Acceptance Criteria
Job still performs the same tasks.
TODO
jobs/JGLOBAL_STAGE_ICto use.pyversion of ex-scriptscripts/exglobal_stage_ic.shtoscripts/exglobal_stage_ic.pyand convert to pythonush/python/pygfs/task/stage.pyand populate with defs for stagingparm/stageand create yaml files within for each stage modestage_icjob setup and dependenciesThe text was updated successfully, but these errors were encountered: