Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add atmos subfolder to relevant DMPDIR paths for authoritative develop and GFS v16.3 implementation #392

Closed
MichaelLueken opened this issue May 24, 2022 · 2 comments · Fixed by #393
Assignees

Comments

@MichaelLueken
Copy link
Contributor

It has been decided to add a $COMPONENT (atmos) subfolder into the global dump archive (GDA) folders:

$CDUMP.$PDY/$cyc -> $CDUMP.$PDY/$cyc/atmos

This will bring the GDA in alignment with related updates to add a $COMPONENT (atmos) subfolder into the GFS and OBSPROC com structures. This is also needed for running the GFS and using compath.py for defining COM paths.

This update is targeted for both the develop branch and the GFSv16.3 package.

From @KateFriedman-NOAA issue #802, adding $COMPONENT to $DMPDIR/$CDUMP.$PDY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc so they look like:

$DMPDIR/$CDUMP.$PDY/$cyc/$COMPONENT
$DMPDIR/$CDUMP.$gPDY/$gcyc/$COMPONENT

This will be done to the following JJOBS:

JGDAS_ATMOS_ANALYSIS_DIAG:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ATMOS_ANALYSIS_DIAG:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGDAS_ATMOS_CHGRES_FORENKF:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ATMOS_CHGRES_FORENKF:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGDAS_ENKF_DIAG:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ENKF_DIAG:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGDAS_ENKF_ECEN:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ENKF_ECEN:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGDAS_ENKF_SELECT_OBS:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ENKF_SELECT_OBS:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGDAS_ENKF_SFC:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGDAS_ENKF_SFC:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGLOBAL_ATMOS_ANALYSIS:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGLOBAL_ATMOS_ANALYSIS:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"
JGLOBAL_ATMOS_ANALYSIS_CALC:    export COMIN_OBS="$DMPDIR/$CDUMP.$PDY/$cyc"
JGLOBAL_ATMOS_ANALYSIS_CALC:    export COMIN_GES_OBS="$DMPDIR/$GDUMP.$gPDY/$gcyc"

This work won't go into develop and release/gfsda.v16.3.0 won't be created (please see issue #391) until atmos symlinks are in place for all GDAs.

This work will be done in feature/atmos_update.

MichaelLueken added a commit to MichaelLueken/GSI that referenced this issue May 24, 2022
…DY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC
@MichaelLueken
Copy link
Contributor Author

In 649893c

Added $COMPONENT to both $DMPDIR/$CDUMP.$PDY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

  • jobs/JGDAS_ATMOS_ANALYSIS_DIAG
  • jobs/JGDAS_ATMOS_CHGRES_FORENKF
  • jobs/JGDAS_ENKF_DIAG
  • jobs/JGDAS_ENKF_ECEN
  • jobs/JGDAS_ENKF_SELECT_OBS
  • jobs/JGDAS_ENKF_SFC
  • jobs/JGLOBAL_ATMOS_ANALYSIS
  • jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

MichaelLueken added a commit to MichaelLueken/GSI that referenced this issue May 27, 2022
…DY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

 * ush/calcanl_gfs.py - patch to make the chgres_inc.x exec run sequentially instead of at the same time.
@MichaelLueken
Copy link
Contributor Author

In b1b4ca9:

Update ush/calcanl_gfs.py to apply patch to make the chgres_inc.x executable run sequentially instead of at the same time.

MichaelLueken added a commit that referenced this issue May 27, 2022
GitHub Issue #392. Add atmos subfolder to relevant DMPDIR paths
MichaelLueken added a commit that referenced this issue May 27, 2022
…and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

 * ush/calcanl_gfs.py - patch to make the chgres_inc.x exec run sequentially instead of at the same time.
MichaelLueken added a commit that referenced this issue May 27, 2022
GitHub Issue #392. Add atmos subfolder to relevant DMPDIR paths
AndrewEichmann-NOAA pushed a commit to AndrewEichmann-NOAA/GSI that referenced this issue Jun 6, 2022
…DY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

 * ush/calcanl_gfs.py - patch to make the chgres_inc.x exec run sequentially instead of at the same time.
AndrewEichmann-NOAA pushed a commit to AndrewEichmann-NOAA/GSI that referenced this issue Jun 6, 2022
…_update

GitHub Issue NOAA-EMC#392. Add atmos subfolder to relevant DMPDIR paths
aerorahul pushed a commit to NOAA-EMC/global-workflow that referenced this issue Jul 12, 2022
…P.$PDY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

 * ush/calcanl_gfs.py - patch to make the chgres_inc.x exec run sequentially instead of at the same time.
aerorahul pushed a commit to NOAA-EMC/global-workflow that referenced this issue Jul 12, 2022
…P.$PDY/$cyc and $DMPDIR/$CDUMP.$gPDY/$gcyc for:

 * jobs/JGDAS_ATMOS_ANALYSIS_DIAG
 * jobs/JGDAS_ATMOS_CHGRES_FORENKF
 * jobs/JGDAS_ENKF_DIAG
 * jobs/JGDAS_ENKF_ECEN
 * jobs/JGDAS_ENKF_SELECT_OBS
 * jobs/JGDAS_ENKF_SFC
 * jobs/JGLOBAL_ATMOS_ANALYSIS
 * jobs/JGLOBAL_ATMOS_ANALYSIS_CALC

 * ush/calcanl_gfs.py - patch to make the chgres_inc.x exec run sequentially instead of at the same time.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants