Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add UFS DA format ATMS radiance bias correction files to ICSDIR_ROOT for C96C48_ufs_hybatmDA CI #2836

Closed
1 of 4 tasks
RussTreadon-NOAA opened this issue Aug 15, 2024 · 5 comments
Closed
1 of 4 tasks

Add UFS DA format ATMS radiance bias correction files to ICSDIR_ROOT for C96C48_ufs_hybatmDA CI #2836

RussTreadon-NOAA opened this issue Aug 15, 2024 · 5 comments
Assignees
@WalterKolczynski-NOAA @KateFriedman-NOAA
Labels
Static Data Mgmt Update of static data (fix, ICs, etc.)

Comments

@RussTreadon-NOAA
Copy link
Contributor

Target fix directory

NEW

Type of change

  • Update existing files
  • Remove files
  • Add new files to existing directory
  • Add new fix directory

Any workflow changes needed?

No change needed

Related issues

NOAA-EMC/global-workflow PR #2833

Pickup location

Cactus: /lfs/h2/emc/da/noscrub/russ.treadon/COMROOT/prjedi/gdas.20240223/18/analysis/atmos

Size

0.09 MB
@RussTreadon-NOAA RussTreadon-NOAA added Static Data Mgmt Update of static data (fix, ICs, etc.) triage Issues that are triage labels Aug 15, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

Additional information

This issue is opened to add JEDI format radiance bias correction files for ATMS_N20 and ATMS_NPP to the ICSDIR_ROOT for C96C48_ufs_hybatmDA CI.

The JEDI format radiance bias correction files are on Cactus in /lfs/h2/emc/da/noscrub/russ.treadon/COMROOT/prjedi/gdas.20240223/18/analysis/atmos

-rw-r--r-- 1 russ.treadon da 22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias_cov.nc
-rw-r--r-- 1 russ.treadon da 22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias.nc
-rw-r--r-- 1 russ.treadon da   547 Aug  5 18:08 gdas.t18z.atms_n20.tlapse.txt
-rw-r--r-- 1 russ.treadon da 22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias_cov.nc
-rw-r--r-- 1 russ.treadon da 22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias.nc
-rw-r--r-- 1 russ.treadon da   547 Aug  5 18:08 gdas.t18z.atms_npp.tlapse.txt

Please copy the above files to /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos

Once the ATMS radiance bias correction files are confirmed to be in the correct location on Cactus, the files should be rsync'd to ${ICSDIR_ROOT}/C96C48/gdas.20240223/18/analysis/atmos on Dogwood, Hera, Hercules (Orion), and Gaea.

@KateFriedman-NOAA KateFriedman-NOAA removed the triage Issues that are triage label Aug 15, 2024
@RussTreadon-NOAA RussTreadon-NOAA mentioned this issue Aug 15, 2024
Merged
7 tasks
@KateFriedman-NOAA
Copy link
Member

Pulled into BASE_IC on both WCOSS2s and Hera. Showing Dogwood below.

@WalterKolczynski-NOAA please sync the C96C48/gdas.20240223/18/analysis/atmos folder to Orion, thanks!

WCOSS2 (PRIMARYSYS-D) atmos> pwd
/lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos
WCOSS2 (PRIMARYSYS-D) atmos> ll
total 82420
-rw-r--r-- 1 emc.global global 84291229 Mar  5 12:13 gdas.t18z.atminc.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_n20.tlapse.txt
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_npp.tlapse.txt

The new symlink timestamp folder also sees the new files without additional work:

WCOSS2 (PRIMARYSYS-D) atmos> ll /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/20240610/gdas.20240223/18/analysis/atmos
lrwxrwxrwx 1 emc.global global 43 Jun 24 15:18 /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/20240610/gdas.20240223/18/analysis/atmos -> ../../../../gdas.20240223/18/analysis/atmos
WCOSS2 (PRIMARYSYS-D) atmos> ll /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/20240610/gdas.20240223/18/analysis/atmos/
total 82420
-rw-r--r-- 1 emc.global global 84291229 Mar  5 12:13 gdas.t18z.atminc.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_n20.tlapse.txt
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_npp.tlapse.txt

@RussTreadon-NOAA
Copy link
Contributor Author

Thank you @KateFriedman-NOAA for quickly copying the files to the Cactus ICSROOT_DIR. Execute

./workflow/create_experiment.py --yaml ./ci/cases/pr/C96C48_ufs_hybatmDA.yaml

in a working copy of PR #2833. Check COMROOT and see JEDI format ATMS radiance bias correction files symlink'd to the correct directory.

russ.treadon@clogin04:/lfs/h2/emc/da/noscrub/russ.treadon/COMROOT/prtest/gdas.20240223/18/analysis/atmos> ls -l
total 28
lrwxrwxrwx 1 russ.treadon da 108 Aug 15 18:57 gdas.t18z.atminc.nc -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atminc.nc
lrwxrwxrwx 1 russ.treadon da 122 Aug 15 18:57 gdas.t18z.atms_n20.satbias_cov.nc -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_n20.satbias_cov.nc
lrwxrwxrwx 1 russ.treadon da 118 Aug 15 18:57 gdas.t18z.atms_n20.satbias.nc -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_n20.satbias.nc
lrwxrwxrwx 1 russ.treadon da 118 Aug 15 18:57 gdas.t18z.atms_n20.tlapse.txt -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_n20.tlapse.txt
lrwxrwxrwx 1 russ.treadon da 122 Aug 15 18:57 gdas.t18z.atms_npp.satbias_cov.nc -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_npp.satbias_cov.nc
lrwxrwxrwx 1 russ.treadon da 118 Aug 15 18:57 gdas.t18z.atms_npp.satbias.nc -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_npp.satbias.nc
lrwxrwxrwx 1 russ.treadon da 118 Aug 15 18:57 gdas.t18z.atms_npp.tlapse.txt -> /lfs/h2/emc/global/noscrub/emc.global/data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/gdas.t18z.atms_npp.tlapse.txt
russ.treadon@clogin04:/lfs/h2/emc/da/noscrub/russ.treadon/COMROOT/prtest/gdas.20240223/18/analysis/atmos> ls -lL
total 82420
-rw-r--r-- 1 emc.global global 84291229 Mar  5 12:13 gdas.t18z.atminc.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_n20.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_n20.tlapse.txt
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias_cov.nc
-rw-r--r-- 1 emc.global global    22260 Aug  5 18:08 gdas.t18z.atms_npp.satbias.nc
-rw-r--r-- 1 emc.global global      547 Aug  5 18:08 gdas.t18z.atms_npp.tlapse.txt

@KateFriedman-NOAA
Copy link
Member

Have also synced to the C96C48 IC set on AWS: https://noaa-nws-global-pds.s3.amazonaws.com/index.html#data/ICSDIR/C96C48/gdas.20240223/18/analysis/atmos/

@WalterKolczynski-NOAA
Copy link
Contributor

Everything should be sync'd to MSU now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@WalterKolczynski-NOAA WalterKolczynski-NOAA

@KateFriedman-NOAA KateFriedman-NOAA

Labels
Static Data Mgmt Update of static data (fix, ICs, etc.)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@RussTreadon-NOAA @WalterKolczynski-NOAA @KateFriedman-NOAA