-
Notifications
You must be signed in to change notification settings - Fork 177
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add initial land DA cycling #1351
Merged
Merged
Changes from all commits
Commits
Show all changes
45 commits
Select commit
Hold shift + click to select a range
fb2f8fb
Add initial land DA cycling.
jiaruidong2017 3e6a3a5
Fix shellcheck error.
jiaruidong2017 47e04e9
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 da71eba
Address the reviwer's comments.
jiaruidong2017 4fafb58
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 67cfc23
Remove "COMPONENT" and replaced with hard-coded "land".
jiaruidong2017 99c6e8d
Merge branch 'landda_pr1' of https://github.com/jiaruidong2017/global…
jiaruidong2017 687508d
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 70c0b79
Revert back to use atmos/ for land component.
jiaruidong2017 a89b280
Address the reviewer's questions.
jiaruidong2017 02108f5
Address the reviewer's comments.
jiaruidong2017 b6e454a
Merge branch 'develop' into landda_pr1
jiaruidong2017 a951ffa
Handle using different observations in different cycles.
jiaruidong2017 de063f3
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 138bb8f
Address the reviewer's comments.
jiaruidong2017 c10af3d
Fix shellcheck warning.
jiaruidong2017 ffa2e1c
Fix the shellcheck errors.
jiaruidong2017 ca947c7
Revert back.
jiaruidong2017 754ef8b
Try.
jiaruidong2017 40da629
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 52f8188
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 4d20e8b
Adress the reviewer's comments.
jiaruidong2017 03480d6
Merge branch 'landda_pr1' of https://github.com/jiaruidong2017/global…
jiaruidong2017 949b4c9
bugfix
jiaruidong2017 587fb86
bugfix2.
jiaruidong2017 f18d7dc
bugfix try.
jiaruidong2017 25f832c
Bugfix try.
jiaruidong2017 186a203
Combine landanlinit and landanlfinal into a single block
jiaruidong2017 2ab93a0
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 049593e
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 5524ff8
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 c6457d8
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 e5fb548
Modify the scripts to align with the aerosol analysis task.
jiaruidong2017 48cea6e
Merge branch 'develop' into landda_pr1
jiaruidong2017 973e2f5
Remove ATML app and add do_JEDILANDDA option.
jiaruidong2017 fcaf0ea
Made a minor correction.
jiaruidong2017 66833f0
Correct the shell norm errors
jiaruidong2017 deb8080
Correct shell check warning.
jiaruidong2017 470d8c5
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 8d4cfac
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 cfab1d3
Made changes by comparing the Russ's PR for the ATM DA.
jiaruidong2017 af29e14
Merge branch 'NOAA-EMC:develop' into landda_pr1
jiaruidong2017 3b8974b
Address the reviwer's comments and suggestions.
jiaruidong2017 13a567a
Remove the '_gfs' resource.
jiaruidong2017 0be71f7
Merge branch 'develop' into landda_pr1
jiaruidong2017 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,50 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
export WIPE_DATA="NO" | ||
export DATA=${DATA:-${DATAROOT}/${RUN}landanl_${cyc}} | ||
source "${HOMEgfs}/ush/jjob_header.sh" -e "landanlfinal" -c "base landanl landanlfinal" | ||
|
||
############################################## | ||
# Set variables used in the script | ||
############################################## | ||
GDATE=$(date +%Y%m%d%H -d "${PDY} ${cyc} - ${assim_freq} hours") | ||
GDUMP="gdas" | ||
|
||
############################################## | ||
# Begin JOB SPECIFIC work | ||
############################################## | ||
|
||
export COMOUT=${COMOUT:-${ROTDIR}/${RUN}.${PDY}/${cyc}/atmos} | ||
mkdir -p "${COMOUT}" | ||
|
||
# COMIN_GES and COMIN_GES_ENS are used in script | ||
export COMIN_GES="${ROTDIR}/${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
|
||
############################################################### | ||
# Run relevant script | ||
|
||
EXSCRIPT=${GDASLANDFINALPY:-${HOMEgfs}/scripts/exglobal_land_analysis_finalize.py} | ||
${EXSCRIPT} | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
############################################## | ||
# End JOB SPECIFIC work | ||
############################################## | ||
|
||
############################################## | ||
# Final processing | ||
############################################## | ||
if [[ -e "${pgmout}" ]] ; then | ||
cat "${pgmout}" | ||
fi | ||
|
||
########################################## | ||
# Remove the Temporary working directory | ||
########################################## | ||
cd "${DATAROOT}" || ( echo "FATAL ERROR: ${DATAROOT} does not exist, ABORT!"; exit 1 ) | ||
[[ ${KEEPDATA} = "NO" ]] && rm -rf "${DATA}" | ||
|
||
exit 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,43 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
export DATA=${DATA:-${DATAROOT}/${RUN}landanl_${cyc}} | ||
source "${HOMEgfs}/ush/jjob_header.sh" -e "landanlinit" -c "base landanl landanlinit" | ||
|
||
############################################## | ||
# Set variables used in the script | ||
############################################## | ||
GDATE=$(date +%Y%m%d%H -d "${PDY} ${cyc} - ${assim_freq} hours") | ||
GDUMP="gdas" | ||
|
||
############################################## | ||
# Begin JOB SPECIFIC work | ||
############################################## | ||
|
||
export COMOUT=${COMOUT:-${ROTDIR}/${RUN}.${PDY}/${cyc}/atmos} | ||
mkdir -p "${COMOUT}" | ||
|
||
# COMIN_GES and COMIN_GES_ENS are used in script | ||
export COMIN_GES="${ROTDIR}/${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
|
||
############################################################### | ||
# Run relevant script | ||
|
||
EXSCRIPT=${GDASLANDINITPY:-${HOMEgfs}/scripts/exglobal_land_analysis_initialize.py} | ||
${EXSCRIPT} | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
############################################## | ||
# End JOB SPECIFIC work | ||
############################################## | ||
|
||
############################################## | ||
# Final processing | ||
############################################## | ||
if [[ -e "${pgmout}" ]] ; then | ||
cat "${pgmout}" | ||
fi | ||
|
||
exit 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
export WIPE_DATA="NO" | ||
export DATA=${DATA:-${DATAROOT}/${RUN}landanl_${cyc}} | ||
source "${HOMEgfs}/ush/jjob_header.sh" -e "landanlrun" -c "base landanl landanlrun" | ||
|
||
############################################## | ||
# Set variables used in the script | ||
############################################## | ||
GDATE=$(date +%Y%m%d%H -d "${PDY} ${cyc} - ${assim_freq} hours") | ||
GDUMP="gdas" | ||
|
||
############################################## | ||
# Begin JOB SPECIFIC work | ||
############################################## | ||
|
||
export COMOUT=${COMOUT:-${ROTDIR}/${RUN}.${PDY}/${cyc}/atmos} | ||
mkdir -p "${COMOUT}" | ||
|
||
# COMIN_GES and COMIN_GES_ENS are used in script | ||
export COMIN_GES="${ROTDIR}/${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${GDATE:0:8}/${GDATE:8:2}/atmos" | ||
|
||
############################################################### | ||
# Run relevant script | ||
|
||
EXSCRIPT=${GDASLANDRUNSH:-${HOMEgfs}/scripts/exglobal_land_analysis_run.sh} | ||
${EXSCRIPT} | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
############################################## | ||
# End JOB SPECIFIC work | ||
############################################## | ||
|
||
############################################## | ||
# Final processing | ||
############################################## | ||
if [[ -e "${pgmout}" ]] ; then | ||
cat "${pgmout}" | ||
fi | ||
|
||
exit 0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
|
||
############################################################### | ||
# Source UFSDA workflow modules | ||
. "${HOMEgfs}/ush/load_ufsda_modules.sh" | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
export job="landanlfinal" | ||
export jobid="${job}.$$" | ||
|
||
############################################################### | ||
# setup python path for workflow utilities and tasks | ||
pygwPATH="${HOMEgfs}/ush/python:${HOMEgfs}/ush/python/pygw/src" | ||
PYTHONPATH="${PYTHONPATH:+${PYTHONPATH}:}${pygwPATH}" | ||
export PYTHONPATH | ||
############################################################### | ||
# Execute the JJOB | ||
"${HOMEgfs}/jobs/JGLOBAL_LAND_ANALYSIS_FINALIZE" | ||
status=$? | ||
exit "${status}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
|
||
############################################################### | ||
# Source UFSDA workflow modules | ||
. "${HOMEgfs}/ush/load_ufsda_modules.sh" | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
export job="landanlinit" | ||
export jobid="${job}.$$" | ||
|
||
############################################################### | ||
# setup python path for workflow utilities and tasks | ||
pygwPATH="${HOMEgfs}/ush/python:${HOMEgfs}/ush/python/pygw/src" | ||
PYTHONPATH="${PYTHONPATH:+${PYTHONPATH}:}${pygwPATH}" | ||
export PYTHONPATH | ||
|
||
############################################################### | ||
# Execute the JJOB | ||
"${HOMEgfs}/jobs/JGLOBAL_LAND_ANALYSIS_INITIALIZE" | ||
status=$? | ||
exit "${status}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
#! /usr/bin/env bash | ||
|
||
source "${HOMEgfs}/ush/preamble.sh" | ||
|
||
############################################################### | ||
# Source UFSDA workflow modules | ||
. "${HOMEgfs}/ush/load_ufsda_modules.sh" | ||
status=$? | ||
[[ ${status} -ne 0 ]] && exit "${status}" | ||
|
||
export job="landanlrun" | ||
export jobid="${job}.$$" | ||
|
||
############################################################### | ||
# setup python path for workflow utilities and tasks | ||
pygwPATH="${HOMEgfs}/ush/python:${HOMEgfs}/ush/python/pygw/src" | ||
PYTHONPATH="${PYTHONPATH:+${PYTHONPATH}:}${pygwPATH}" | ||
export PYTHONPATH | ||
|
||
############################################################### | ||
# Execute the JJOB | ||
"${HOMEgfs}/jobs/JGLOBAL_LAND_ANALYSIS_RUN" | ||
status=$? | ||
exit "${status}" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
#! /usr/bin/env bash | ||
|
||
########## config.landanl ########## | ||
# configuration common to all land analysis tasks | ||
|
||
echo "BEGIN: config.landanl" | ||
|
||
obs_list_name=gdas_land_adpsfc_only.yaml | ||
if [[ "${cyc}" == "18" ]]; then | ||
obs_list_name=gdas_land_prototype.yaml | ||
fi | ||
|
||
export OBS_YAML_DIR=${HOMEgfs}/sorc/gdas.cd/parm/land/obs/config/ | ||
export OBS_LIST=${HOMEgfs}/sorc/gdas.cd/parm/land/obs/lists/${obs_list_name} | ||
export LANDVARYAML=${HOMEgfs}/sorc/gdas.cd/parm/land/letkfoi/letkfoi.yaml | ||
export FV3JEDI_FIX=${HOMEgfs}/fix/gdas | ||
|
||
export io_layout_x=@IO_LAYOUT_X@ | ||
export io_layout_y=@IO_LAYOUT_Y@ | ||
|
||
export JEDIEXE=${HOMEgfs}/exec/fv3jedi_letkf.x | ||
|
||
echo "END: config.landanl" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
#! /usr/bin/env bash | ||
|
||
########## config.landanlfinal ########## | ||
# Post Land Analysis specific | ||
|
||
echo "BEGIN: config.landanlfinal" | ||
|
||
# Get task specific resources | ||
. "${EXPDIR}/config.resources" landanlfinal | ||
echo "END: config.landanlfinal" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
#! /usr/bin/env bash | ||
|
||
########## config.landanlinit ########## | ||
# Pre Land Analysis specific | ||
|
||
echo "BEGIN: config.landanlinit" | ||
|
||
# Get task specific resources | ||
. "${EXPDIR}/config.resources" landanlinit | ||
echo "END: config.landanlinit" |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this going to be used? @RussTreadon-NOAA had removed its reference.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should be consistent, I don't think it's needed now as long as the fix directory is linked
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@aerorahul I checked that @RussTreadon-NOAA still kept this reference in the
config.atmanl
, and similar for theconfig.aeroanl
. Therefore, we keep this reference here for consistency.