Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GFSv16.3.20 - Annual CO2 update for 2025 and turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data #2558

Closed
KateFriedman-NOAA opened this issue May 1, 2024 · 13 comments
Closed

GFSv16.3.20 - Annual CO2 update for 2025 and turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data #2558

KateFriedman-NOAA opened this issue May 1, 2024 · 13 comments
Assignees
@Qingfu-Liu @KateFriedman-NOAA
Labels
production update Processing update in production

Comments

@KateFriedman-NOAA
Copy link
Member

KateFriedman-NOAA commented May 1, 2024 •
edited
Loading

Description

The annual update to CO2 fix files, as well as updates to storm names for the 2025, 2026, and 2027 hurricane seasons.

Updated fix files will be provided by @Qingfu-Liu .

This issue is on hold until fall 2024 for the regular annual update time.

Document from @Qingfu-Liu : https://docs.google.com/document/d/1sWaex-8cfETPajB7DKfG-fN_TK5WK_et/edit#heading=h.gjdgxs

Target version

v16.3.20

Expected workflow changes

None
@KateFriedman-NOAA KateFriedman-NOAA added production update Processing update in production ON HOLD labels May 1, 2024
@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16.3.? - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons GFSv16.?.? - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons Aug 27, 2024
@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16.?.? - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons GFSv16 - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons Oct 24, 2024
@KateFriedman-NOAA
Copy link
Member Author

The new CO2 files have been pulled into the para install for gfs.v16.3.20 by @DianeStokes-NCO . This issue will close when #2913 is completed.

@KateFriedman-NOAA
Copy link
Member Author

as well as updates to storm names for the 2025, 2026, and 2027 hurricane seasons.

@Qingfu-Liu were the storm name updates included in the files you provided recently?

@KateFriedman-NOAA
Copy link
Member Author

Files copied into GFSv16 fix set on WCOSS2 for pickup by NCO:

WCOSS2 (PRIMARYSYS-D) fix_am> pwd
/lfs/h2/emc/global/save/emc.global/FIX/fix_nco_gfsv16.3.0/fix_am
WCOSS2 (PRIMARYSYS-D) fix_am> ll co2dat_4a/global_co2historicaldata_2023.txt co2dat_4a/global_co2historicaldata_2024.txt_proj_u co2dat_4a/global_co2historicaldata_2025.txt_proj fix_co2_proj/global_co2historicaldata_2025.txt fix_co2_update/global_co2historicaldata_2024.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2023.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2024.txt_proj_u
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2025.txt_proj
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_proj/global_co2historicaldata_2025.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_update/global_co2historicaldata_2024.txt

@KateFriedman-NOAA
Copy link
Member Author

Rsync'd the new fix files to the developmental fix sets on WCOSS2 and then to Hera and Jet:

+ cd /lfs/h2/emc/global/noscrub/emc.global/FIX/fix/am/
+ rsync -azv 20220805 role.glopara@dtn-hera.fairmont.rdhpcs.noaa.gov:/scratch1/NCEPDEV/global/glopara/fix/am/
sending incremental file list
20220805/co2dat_4a/
20220805/co2dat_4a/global_co2historicaldata_2023.txt
20220805/co2dat_4a/global_co2historicaldata_2024.txt_proj_u
20220805/co2dat_4a/global_co2historicaldata_2025.txt_proj
20220805/fix_co2_proj/
20220805/fix_co2_proj/global_co2historicaldata_2025.txt
20220805/fix_co2_update/
20220805/fix_co2_update/global_co2historicaldata_2024.txt

sent 57,889 bytes  received 134 bytes  6,826.24 bytes/sec
total size is 6,912,953,183  speedup is 119,141.60

Also synced to AWS:

[role.glopara@hfe02 AWS]$ sh copy_fix_aws_bucket.sh am/20220805
+ aws s3 sync am/20220805/ s3://noaa-nws-global-pds/fix/am/20220805/
upload: am/20220805/co2dat_4a/global_co2historicaldata_2023.txt to s3://noaa-nws-global-pds/fix/am/20220805/co2dat_4a/global_co2historicaldata_2023.txt
upload: am/20220805/co2dat_4a/global_co2historicaldata_2025.txt_proj to s3://noaa-nws-global-pds/fix/am/20220805/co2dat_4a/global_co2historicaldata_2025.txt_proj
upload: am/20220805/co2dat_4a/global_co2historicaldata_2024.txt_proj_u to s3://noaa-nws-global-pds/fix/am/20220805/co2dat_4a/global_co2historicaldata_2024.txt_proj_u
upload: am/20220805/fix_co2_update/global_co2historicaldata_2024.txt to s3://noaa-nws-global-pds/fix/am/20220805/fix_co2_update/global_co2historicaldata_2024.txt
upload: am/20220805/fix_co2_proj/global_co2historicaldata_2025.txt to s3://noaa-nws-global-pds/fix/am/20220805/fix_co2_proj/global_co2historicaldata_2025.txt

@WalterKolczynski-NOAA please sync the fix/am/20220805 subset to MSU, thanks!

@Qingfu-Liu
Copy link

Qingfu-Liu commented Oct 24, 2024 via email

@KateFriedman-NOAA
Copy link
Member Author

@Qingfu-Liu Understood, thanks for that info!

@KateFriedman-NOAA
Copy link
Member Author

From the October 25th RFC memo:

RFC 13371 - On WCOSS2, install 2025 carbon dioxide (CO2) fix file updates for
several model packages. The GEFS, NAM, SREF, HIRESW, HMON, HAFS,
CFS, and CFS_HUR models rely on the historical/projected global CO2
abundance data in their forecasts. To be implemented on October 29 from 1145Z
to 1930Z. The GFS uses CO2 but is not being updated at this time. A GFS
update is coming before the end of the year which will include the code to read
the 2025 CO2 input.

@EricSinsky-NOAA
Copy link
Contributor

@KateFriedman-NOAA Can you also add the new CO2 files to the following directory on WCOSS2? /lfs/h2/emc/global/save/emc.global/FIX/fix_nco_gfsv15/fix_am/

This fix directory is copied during the production GEFSv12 build process.

@KateFriedman-NOAA
Copy link
Member Author

KateFriedman-NOAA commented Oct 28, 2024 •
edited
Loading

@EricSinsky-NOAA Certainly! Done, copied into the fix_nco_gfsv15 sets on both sides of WCOSS2:

WCOSS2 (BACKUPSYS-C) fix_am> ll co2dat_4a/global_co2historicaldata_2023.txt co2dat_4a/global_co2historicaldata_2024.txt_proj_u co2dat_4a/global_co2historicaldata_2025.txt_proj fix_co2_proj/global_co2historicaldata_2025.txt fix_co2_update/global_co2historicaldata_2024.txt                                                                       
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2023.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2024.txt_proj_u
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2025.txt_proj
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_proj/global_co2historicaldata_2025.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_update/global_co2historicaldata_2024.txt

@EricSinsky-NOAA
Copy link
Contributor

@EricSinsky-NOAA Certainly! Done, copied into the fix_nco_gfsv15 sets on both sides of WCOSS2:

WCOSS2 (BACKUPSYS-C) fix_am> ll co2dat_4a/global_co2historicaldata_2023.txt co2dat_4a/global_co2historicaldata_2024.txt_proj_u co2dat_4a/global_co2historicaldata_2025.txt_proj fix_co2_proj/global_co2historicaldata_2025.txt fix_co2_update/global_co2historicaldata_2024.txt                                                                       
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2023.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2024.txt_proj_u
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 co2dat_4a/global_co2historicaldata_2025.txt_proj
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_proj/global_co2historicaldata_2025.txt
-rw-r--r-- 1 emc.global global 24484 Oct  7 20:55 fix_co2_update/global_co2historicaldata_2024.txt

Thank you, @KateFriedman-NOAA. All looks good.

@KateFriedman-NOAA
Copy link
Member Author

NCO pulled the updated fix files into the GFSv16.3.20 install. This issue will be resolved alongside issue #2913.

@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Nov 5, 2024
Open
2 tasks
@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16 - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons GFSv16.3.20 - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons Dec 5, 2024
@KateFriedman-NOAA
Copy link
Member Author

From the 12/6/24 RFC memo:

RFC 13485 - On WCOSS2, upgrade the GFS to v16.3.20. This includes the
following changes:
● install 2025 carbon dioxide (CO2) fix file updates before the start of the
new year;
● turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data;
● load the cmdaccel module at the start of wave point postprocessor jobs to
stabilize runtime.
To be implemented on December 9 from 1330Z to 2000Z.

KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 6, 2024
@KateFriedman-NOAA
Adjusted changes for scaled down GFSv16.3.20
9c1e9c4 
The obsproc/v1.3 upgrade is delayed, therefore,
the v16.3.20 will now update the following:

- install 2025 carbon dioxide (CO2) fix file updates before
  the start of the new year
- updated GSI global_convinfo.txt to turn on assimilation of
  PlanetiQ GPS Radio Occultation (GPS-RO) data
- memory increases for a number of jobs (provided by NCO)
- load the cmdaccel module at the start of wave point
  postprocessor jobs to stabilize runtime

Refs NOAA-EMC#2558
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 6, 2024
@KateFriedman-NOAA
Update prelude in release notes
511234f 
Refs NOAA-EMC#2558
@KateFriedman-NOAA KateFriedman-NOAA changed the title GFSv16.3.20 - Annual CO2 update for 2025 and updated storm names for 2025[6][7] hurricane seasons GFSv16.3.20 - Annual CO2 update for 2025 and turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data Dec 6, 2024
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Dec 6, 2024
Merged
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 9, 2024
@KateFriedman-NOAA
Increase gempak memory to 150GB
574d8c5 
Refs NOAA-EMC#2558
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 9, 2024
@KateFriedman-NOAA
Update GSI tag to gfsda.v16.3.20
17bed9d 
New tag includes updated global_convinfo.txt for turning
on PlanetIQ assimilation.

Refs NOAA-EMC#2558
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 9, 2024
@KateFriedman-NOAA
Add updated resource note in release notes
c867eda 
Refs NOAA-EMC#2558
KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Dec 9, 2024
@KateFriedman-NOAA
Temporary increase to enkfgdas_update walltime
7552cf4 
NCO increased the walltime for the eupd job to 40mins.

Refs NOAA-EMC#2558
KateFriedman-NOAA added a commit that referenced this issue Dec 17, 2024
@KateFriedman-NOAA
Reduce scope to annual CO2 update and PlanetIQ assimilation (#3144)
938415b 
The `obsproc/v1.3` upgrade is delayed, therefore, the `GFSv16.3.20` will
now update the following:

- install 2025 carbon dioxide (CO2) fix file updates before the start of the new year
- updated GSI global_convinfo.txt to turn on assimilation of PlanetiQ GPS Radio Occultation (GPS-RO) data
- memory increases for a number of jobs (provided by NCO)
- load the cmdaccel module at the start of wave point postprocessor jobs to stabilize runtime (provided by NCO)

Refs #2558
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Dec 17, 2024
Merged
KateFriedman-NOAA added a commit that referenced this issue Dec 17, 2024
@KateFriedman-NOAA
GFSv16.3.20 - annual CO2 update and PlanetIQ assimilation (#3174)
47454d7 
GFSv16.3.20 includes the following updates:

- annual carbon dioxide (CO2) fix file updates for 2025 (within staged fix set on WCOSS2)
- updated GSI global_convinfo.txt to turn on assimilation of PlanetIQ GPS Radio Occultation (GPS-RO) data
- memory increases for a number of jobs (provided by NCO)
- load the cmdaccel module at the start of wave point postprocessor jobs to stabilize runtime (provided by NCO)

Refs #2558
@KateFriedman-NOAA
Copy link
Member Author

This operational update is complete, it has been tagged and released to users. Closing as complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Qingfu-Liu Qingfu-Liu

@KateFriedman-NOAA KateFriedman-NOAA

Labels
production update Processing update in production
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Qingfu-Liu @KateFriedman-NOAA @EricSinsky-NOAA