diff --git a/docs/Release_Notes.gfs.v15.2.0.txt b/docs/Release_Notes.gfs.v15.2.0.txt deleted file mode 100644 index 4f3cbcddd9..0000000000 --- a/docs/Release_Notes.gfs.v15.2.0.txt +++ /dev/null @@ -1,261 +0,0 @@ -GFS v15.2.0 RELEASE NOTES - - -PRELUDE (taken from GFS v15.2.0 SCN) - - GFS version 15.1 was implemented into operation at the 12Z cycle on June 12, 2019. It was the first - GFS implementation with the finite­ volume cubed-sphere (FV3) dynamical core as the Weather Service’s - Next Generation Global Prediction System (NGGPS). - - GFS version 15.2 is a minor upgrade. The major change to the system is to ingest new and replacement - satellite observations for data assimilation. It also contains a few other minor upgrades and bug fixes. - - 1) Assimilate new satellite observations - * GOES-17 AMVs - * GOES-17 has already replaced GOES-15 as the operational GOES-West satellite. Distribution of - GOES-15 products is expected to cease around December 2019 and active assimilation of GOES-17 - AMVs is required to prevent a gap in data coverage. - * Metop-C AMSU and MHS - * Metop-C is now the primary satellite in the 9:30 AM orbit. Assimilation of these data provide - additional impact as well as adding robustness to the system. - * KOMPSAT-5 (GPS-RO) - * Provides additional robustness to the system. - * Addition changes are made to VIIRS AMV ingest code to allow continued use after an expected change - to the BUFR format. - - 2) Assimilate buoyb sea-surface temperature (SST) data - TAC2BUFR changes in the buoy network resulted in a reduction of available SST measurements from buoys - to 10% or less of expected levels. Obsproc and GSI changes were required to restore data counts to - previous levels. - - 3) New product: Graphical Turbulence Guidance (GTG) - Global Turbulence product generated using NCAR GTG algorithm will start being disseminated on NOMADS. - The product will be available 3 hourly from F06 to F36 and horizontal resolution will be a quarter - degree. gfs.t{CC}Z.gtg.0p25.grb2f{HHH} - - 4) Update the Unified Post Processor(UPP) to address a mask issue of several land surface fields over - water bodies in grib2 products. - - This update will make GFS.v15.2 p-grid products to be more consistent with GFS.v14 products, and - remove spurious soil moisture along coastlines. These land surface fields include Soil Moisture, - Soil Temperature, Liquid Volumetric Soil Moisture, WEASD, Snow Depth, Water Runoff, GFLUX Ground - Heat Flux, WILT Wilting Point, and FLDCP Field Capacity. - - Affected product files are: - gfs.t{CC}Z.pgrb2.0p25.F{HHH} - gfs.t{CC}Z.pgrb2b.0p25.g{HHH} - gfs.t{CC}Z.pgrb2.0p50.F{HHH} - gfs.t{CC}Z.pgrb2b.0p50.g{HHH} - gfs.t{CC}Z.pgrb2.1p00.F{HHH} - gfs.t{CC}Z.pgrb2b.1p00.g{HHH} - gfs.t{CC}Z.sfluxgrbf{HHH}.grib2 - Where CC is cycle for 00, 06, 12, 18 UTC, and HHH is forecast hour. - - 5) The vessel icing program uses OISST as input. OISST will not be ported from WCOSS Phase 1 to Phase 3 - after Phase 1 is decommissioned in 2020. A decision was made to move the vessel icing program - within the Unified Post Processor(UPP) and use GFS forecast skin temperature as input. Current vessel - icing product in operation (sice.tCCz.siceg) has a 1-deg resolution and is disseminated to the public at - - ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/omb/prod/sice.yyyymmdd/ - - New vessel icing product will be included as a variable (ICEG) in GFS p-grid products gfs.tCCz.pgrb2.xpxx.fxxx - and gfs.tCCz.pgrb2b.xpxx.fxxx at 0.25, 0.5, and 1.0-deg resolutions, and be disseminated to the public at - - ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gfs.yyyymmdd/ - - 6) Added three stations to station time series bufr soundings: - - 006011 62.02N 6.76W TOR 00 Thorshvan, Denmark 54 Usr Rqst 4-19 - 999913 15.51S 128.15E WYN 00 Wyndham aerodrome Australia 4 Usr Rqst 1-19 - 999914 57.48N 7.36W EGPL 00 Benbecula, Scotland, UK 6 Usr Rqst 1-19 - - The affected output files are: - gfs_yyyymmddhh.sfc - gfs_yyyymmddhh.snd - gfs.tCCz.bufrsnd.tar.gz - - Three additional files for the stations: - bufr.006011.yyyymmddhh - bufr.999913.yyyymmddhh - bufr.999914.yyyymmddhh - - 7) Reduction of water temperature biases in small lakes. - For small lakes adequate observations do not always exit to support the analysis of lake surface - temperature, often leading to significant departures from both the climatology and real-time observation. - Two changes were introduced to ensure that lake temperatures do not deviate from the climatology when - observations are not available. The first change is to replace a surface mask file at 0.5-degree - resolution with the one on the T1534 Gaussian grid (~13km) to prevent unrealistic SST climatology - from being used for updating the background of the near sea-surface temperature analysis over small - water bodies, such as those in the Great Salt Lake. The second change is to reduce the relaxation - time scale of the SST to climatology in GDAS forecast step from 90 days to 10 days. - - 8) Changes to NOAAPORT/SBN - Product Removals - * GADS FAX product which contains tropical surface analysis in TIF format with G4 compression. - - - -IMPLEMENTATION INSTRUCTIONS - - * NOAA Vlab GIT is used to manage GFS.v15.2 code. The SPA(s) handling the GFS.v15.2 implementation need to have - permission to clone Vlab gerrit repositories. So far Wojciech Cencek has been given access to all GFS.v15.2 - related git repositories. Please contact Kate.Friedman@noaa.gov or Hang.Lei@noaa.gov if there is any VLAB - access issue and/or the individual code managers listed under item #6) below. Please follow the following - steps to install the package on WCOSS DELL - - 1) cd $NWROOTp3 - 2) mkdir gfs.v15.2.0 - 3) cd gfs.v15.2.0 - 4) git clone --recursive gerrit:global-workflow . - 5) git checkout feature/dev-v15.2 - 6) cd sorc - 7) ./checkout.sh - This script extracts the following GFS components from gerrit - MODEL -- tag nemsfv3_gfsv15.2.1 Jun.Wang@noaa.gov - GSI -- tag fv3da_gfs.v15.2.0 Russ.Treadon@noaa.gov - UPP -- tag ncep_post_gtg.v1.1.4 Wen.Meng@noaa.gov - WAFS -- tag gfs_wafs.v5.0.9 Yali.Mao@noaa.gov - - - 8) ./build_all.sh - *This script compiles all GFS components. Runtime output from the build for each package is written - to log files in directory logs. To build an individual program, for instance, gsi, use build_gsi.sh. - - 9) ./link_fv3gfs.sh nco dell - - * Note: 1) ecflow suite definition and scripts are saved in gfs.v15.2.0/ecflow/ecf - 2) ncep_post_gtg.v1.1.4 contains restricted GTG (Graphic Turbulence Guidance) code provided by - NCAR. Please do not post the GTG code in any public domain. - - - - -JOB CHANGES - - * See docs/Release_Notes.gfs_downstream.v15.2.0.txt - - -SORC CHANGES - - * sorc/ - * checkout.sh - update to check out the following tags - * NEMSfv3gfs nemsfv3_gfsv15.2.1 - * ProdGSI fv3da_gfsv15.2.0 - * EMC_post_gtg ncep_post_gtg.v1.1.4 - * EMC_gfs_wafs gfs_wafs.v5.0.9 - * sorc/global_chgres.fd/ - * sfcsub.F - bug fix. set logical variable (lmask) to be false for a land surface variable - * sorc/global_cycle.fd/ - * sfcsub.F - bug fix. set logical variable (lmask) to be false for a land surface variable - - -SCRIPT CHANGES - - * scripts/ - * run_gfsmos_master.sh.cray - remove reference to COMROOTp1 - * run_gfsmos_master.sh.dell - remove reference to COMROOTp1 - * additional script changes documented in docs/Release_Notes.gfs_downstream.v15.2.0.txt - - -PARM/CONFIG CHANGES - - * parm/ - * Two files are modified to set a - * parm/config/config.base.emc.dyn - set 10 day relaxaion time scale to SST climatology in GDAS forecast - * parm/config/config.base.nco.static - set 10 day relaxaion time scale to SST climatology in GDAS forecast - - * Two files were modified for adding three bufr stations: - * parm/product/bufr_stalist.meteo.gfs - * parm/product/bufr_stalist.meteo.gfs3 - - -FIX CHANGES - - * Files in fix/fix_gsi altered by GFS DA v15.2. See GFS DA v15.2 release notes - (sorc/gsi.fd/doc/Release_Notes.gfs_da.v15.2.0.txt) for details - - -PRODUCT CHANGES - - * see SCN - - -RESOURCE INFORMATION - - * Frequency of run - * No change from GFS v15.1 - - * Commonly used libraries, compiler, and modules are defined in gfs.v15.2.0/modulefiles. For nemsfv3gfs, gsi, upp, wafs - they maintain their own module files under gfs.v15.2.0/sorc/(fv3gfs gsi gfs_post global_wafs).fd/modulefiles - * GSI updated to use bufr/11.3.0 - - * Data retention time under $COMROOTp3 for GFS.v15.2 should be the same as GFS.v15.1. - - * Disk space: - * About 4 Gb more per gdas cycle due to additional observation data in gdas and enkf diagnostic files - - * Computational resources and run times: - * Due to processing additional observation data the runtime for the following jobs increases with - respect to GFS v15.1 as noted below - * gfs_analysis : about 30 seconds longer (27.4 minutes for GFS v15.1 -vs- 27.9 minutes for GFS v15.2) - * gdas_enkf_select_obs : about 1 minute longer (3.7 for GFS v15.1 -vs- 4.7 for GFS v15.2) - * gdas_enkf_innovate_obs_grp*: about 30 seconds longer (14.8 for GFS v15.1 -vs - 15.3 for GFS v15.2) - * gdas_enkf_update : about 20 seconds longer (6.4 for GFS v15.1 -vs- 6.7 for GFS v15.2) - - - -PRE-IMPLEMENTATION TESTING REQUIREMENTS - - * Which production jobs should be tested as part of this implementation? - * The entire GFS v15.2 package needs to be installed and tested. EMC can run the same date - and compare NCO and EMC output to confirm the EMC and NCO tests reproduce each other - - * Does this change require a 30-day evaluation? - * No. - - - * Suggested evaluators - * Please contact the following EMC staff for the indicated components - Fanglin.Yang@noaa.gov - MODEL - Russ.Treadon@noaa.gov - DA - Wen.Meng@noaa.gov - UPP - Yali.Mao@noaa.gov - WAFS - Boi.Vuong@noaa.gov - downstream products - - -DISSEMINATION INFORMATION - - * Where should this output be sent? - * No change from GFS v15.1 - - * Who are the users? - * No change from GFS v15.1 - - * Which output files should be transferred from PROD WCOSS to DEV WCOSS? - * No change from GFS v15.1 - - * Directory changes - * No change from GFS v15.1 - - * File changes. - * See SCN - - -HPSS ARCHIVE - - No change from GFS v15.1 - - - -JOB DEPENDENCIES & FLOW DIAGRAM - * No change from GFS v15.1 - - -=========== -Prepared by -Fanglin.Yang@noaa -Russ.Treadon@noaa.gov -Boi.Vuong@noaa.gov -Wen.Meng@noaa.gov - - diff --git a/docs/Release_Notes.gfs.v15.2.2.txt b/docs/Release_Notes.gfs.v15.2.2.txt deleted file mode 100644 index c1978fcf23..0000000000 --- a/docs/Release_Notes.gfs.v15.2.2.txt +++ /dev/null @@ -1,269 +0,0 @@ -GFS v15.2.2 - updated by SPA on 11/13/2019 - -Fixed missing gempak pathes in GFS_GEMPAK_NCDC_UPAPGIF job that caused the black/white background switch in the Fax chart. - -Change: -jobs/JGFS_GEMPAK_NCDC_UPAPGIF - - -GFS v15.2.0 RELEASE NOTES - - -PRELUDE (taken from GFS v15.2.0 SCN) - - GFS version 15.1 was implemented into operation at the 12Z cycle on June 12, 2019. It was the first - GFS implementation with the finite­ volume cubed-sphere (FV3) dynamical core as the Weather Service’s - Next Generation Global Prediction System (NGGPS). - - GFS version 15.2 is a minor upgrade. The major change to the system is to ingest new and replacement - satellite observations for data assimilation. It also contains a few other minor upgrades and bug fixes. - - 1) Assimilate new satellite observations - * GOES-17 AMVs - * GOES-17 has already replaced GOES-15 as the operational GOES-West satellite. Distribution of - GOES-15 products is expected to cease around December 2019 and active assimilation of GOES-17 - AMVs is required to prevent a gap in data coverage. - * Metop-C AMSU and MHS - * Metop-C is now the primary satellite in the 9:30 AM orbit. Assimilation of these data provide - additional impact as well as adding robustness to the system. - * KOMPSAT-5 (GPS-RO) - * Provides additional robustness to the system. - * Addition changes are made to VIIRS AMV ingest code to allow continued use after an expected change - to the BUFR format. - - 2) Assimilate buoyb sea-surface temperature (SST) data - TAC2BUFR changes in the buoy network resulted in a reduction of available SST measurements from buoys - to 10% or less of expected levels. Obsproc and GSI changes were required to restore data counts to - previous levels. - - 3) New product: Graphical Turbulence Guidance (GTG) - Global Turbulence product generated using NCAR GTG algorithm will start being disseminated on NOMADS. - The product will be available 3 hourly from F06 to F36 and horizontal resolution will be a quarter - degree. gfs.t{CC}Z.gtg.0p25.grb2f{HHH} - - 4) Update the Unified Post Processor(UPP) to address a mask issue of several land surface fields over - water bodies in grib2 products. - - This update will make GFS.v15.2 p-grid products to be more consistent with GFS.v14 products, and - remove spurious soil moisture along coastlines. These land surface fields include Soil Moisture, - Soil Temperature, Liquid Volumetric Soil Moisture, WEASD, Snow Depth, Water Runoff, GFLUX Ground - Heat Flux, WILT Wilting Point, and FLDCP Field Capacity. - - Affected product files are: - gfs.t{CC}Z.pgrb2.0p25.F{HHH} - gfs.t{CC}Z.pgrb2b.0p25.g{HHH} - gfs.t{CC}Z.pgrb2.0p50.F{HHH} - gfs.t{CC}Z.pgrb2b.0p50.g{HHH} - gfs.t{CC}Z.pgrb2.1p00.F{HHH} - gfs.t{CC}Z.pgrb2b.1p00.g{HHH} - gfs.t{CC}Z.sfluxgrbf{HHH}.grib2 - Where CC is cycle for 00, 06, 12, 18 UTC, and HHH is forecast hour. - - 5) The vessel icing program uses OISST as input. OISST will not be ported from WCOSS Phase 1 to Phase 3 - after Phase 1 is decommissioned in 2020. A decision was made to move the vessel icing program - within the Unified Post Processor(UPP) and use GFS forecast skin temperature as input. Current vessel - icing product in operation (sice.tCCz.siceg) has a 1-deg resolution and is disseminated to the public at - - ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/omb/prod/sice.yyyymmdd/ - - New vessel icing product will be included as a variable (ICEG) in GFS p-grid products gfs.tCCz.pgrb2.xpxx.fxxx - and gfs.tCCz.pgrb2b.xpxx.fxxx at 0.25, 0.5, and 1.0-deg resolutions, and be disseminated to the public at - - ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gfs.yyyymmdd/ - - 6) Added three stations to station time series bufr soundings: - - 006011 62.02N 6.76W TOR 00 Thorshvan, Denmark 54 Usr Rqst 4-19 - 999913 15.51S 128.15E WYN 00 Wyndham aerodrome Australia 4 Usr Rqst 1-19 - 999914 57.48N 7.36W EGPL 00 Benbecula, Scotland, UK 6 Usr Rqst 1-19 - - The affected output files are: - gfs_yyyymmddhh.sfc - gfs_yyyymmddhh.snd - gfs.tCCz.bufrsnd.tar.gz - - Three additional files for the stations: - bufr.006011.yyyymmddhh - bufr.999913.yyyymmddhh - bufr.999914.yyyymmddhh - - 7) Reduction of water temperature biases in small lakes. - For small lakes adequate observations do not always exit to support the analysis of lake surface - temperature, often leading to significant departures from both the climatology and real-time observation. - Two changes were introduced to ensure that lake temperatures do not deviate from the climatology when - observations are not available. The first change is to replace a surface mask file at 0.5-degree - resolution with the one on the T1534 Gaussian grid (~13km) to prevent unrealistic SST climatology - from being used for updating the background of the near sea-surface temperature analysis over small - water bodies, such as those in the Great Salt Lake. The second change is to reduce the relaxation - time scale of the SST to climatology in GDAS forecast step from 90 days to 10 days. - - 8) Changes to NOAAPORT/SBN - Product Removals - * GADS FAX product which contains tropical surface analysis in TIF format with G4 compression. - - - -IMPLEMENTATION INSTRUCTIONS - - * NOAA Vlab GIT is used to manage GFS.v15.2 code. The SPA(s) handling the GFS.v15.2 implementation need to have - permission to clone Vlab gerrit repositories. So far Wojciech Cencek has been given access to all GFS.v15.2 - related git repositories. Please contact Kate.Friedman@noaa.gov or Hang.Lei@noaa.gov if there is any VLAB - access issue and/or the individual code managers listed under item #6) below. Please follow the following - steps to install the package on WCOSS DELL - - 1) cd $NWROOTp3 - 2) mkdir gfs.v15.2.0 - 3) cd gfs.v15.2.0 - 4) git clone --recursive gerrit:global-workflow . - 5) git checkout feature/dev-v15.2 - 6) cd sorc - 7) ./checkout.sh - This script extracts the following GFS components from gerrit - MODEL -- tag nemsfv3_gfsv15.2.1 Jun.Wang@noaa.gov - GSI -- tag fv3da_gfs.v15.2.0 Russ.Treadon@noaa.gov - UPP -- tag ncep_post_gtg.v1.1.4 Wen.Meng@noaa.gov - WAFS -- tag gfs_wafs.v5.0.9 Yali.Mao@noaa.gov - - - 8) ./build_all.sh - *This script compiles all GFS components. Runtime output from the build for each package is written - to log files in directory logs. To build an individual program, for instance, gsi, use build_gsi.sh. - - 9) ./link_fv3gfs.sh nco dell - - * Note: 1) ecflow suite definition and scripts are saved in gfs.v15.2.0/ecflow/ecf - 2) ncep_post_gtg.v1.1.4 contains restricted GTG (Graphic Turbulence Guidance) code provided by - NCAR. Please do not post the GTG code in any public domain. - - - - -JOB CHANGES - - * See docs/Release_Notes.gfs_downstream.v15.2.0.txt - - -SORC CHANGES - - * sorc/ - * checkout.sh - update to check out the following tags - * NEMSfv3gfs nemsfv3_gfsv15.2.1 - * ProdGSI fv3da_gfsv15.2.0 - * EMC_post_gtg ncep_post_gtg.v1.1.4 - * EMC_gfs_wafs gfs_wafs.v5.0.9 - * sorc/global_chgres.fd/ - * sfcsub.F - bug fix. set logical variable (lmask) to be false for a land surface variable - * sorc/global_cycle.fd/ - * sfcsub.F - bug fix. set logical variable (lmask) to be false for a land surface variable - - -SCRIPT CHANGES - - * scripts/ - * run_gfsmos_master.sh.cray - remove reference to COMROOTp1 - * run_gfsmos_master.sh.dell - remove reference to COMROOTp1 - * additional script changes documented in docs/Release_Notes.gfs_downstream.v15.2.0.txt - - -PARM/CONFIG CHANGES - - * parm/ - * Two files are modified to set a - * parm/config/config.base.emc.dyn - set 10 day relaxaion time scale to SST climatology in GDAS forecast - * parm/config/config.base.nco.static - set 10 day relaxaion time scale to SST climatology in GDAS forecast - - * Two files were modified for adding three bufr stations: - * parm/product/bufr_stalist.meteo.gfs - * parm/product/bufr_stalist.meteo.gfs3 - - -FIX CHANGES - - * Files in fix/fix_gsi altered by GFS DA v15.2. See GFS DA v15.2 release notes - (sorc/gsi.fd/doc/Release_Notes.gfs_da.v15.2.0.txt) for details - - -PRODUCT CHANGES - - * see SCN - - -RESOURCE INFORMATION - - * Frequency of run - * No change from GFS v15.1 - - * Commonly used libraries, compiler, and modules are defined in gfs.v15.2.0/modulefiles. For nemsfv3gfs, gsi, upp, wafs - they maintain their own module files under gfs.v15.2.0/sorc/(fv3gfs gsi gfs_post global_wafs).fd/modulefiles - * GSI updated to use bufr/11.3.0 - - * Data retention time under $COMROOTp3 for GFS.v15.2 should be the same as GFS.v15.1. - - * Disk space: - * About 4 Gb more per gdas cycle due to additional observation data in gdas and enkf diagnostic files - - * Computational resources and run times: - * Due to processing additional observation data the runtime for the following jobs increases with - respect to GFS v15.1 as noted below - * gfs_analysis : about 30 seconds longer (27.4 minutes for GFS v15.1 -vs- 27.9 minutes for GFS v15.2) - * gdas_enkf_select_obs : about 1 minute longer (3.7 for GFS v15.1 -vs- 4.7 for GFS v15.2) - * gdas_enkf_innovate_obs_grp*: about 30 seconds longer (14.8 for GFS v15.1 -vs - 15.3 for GFS v15.2) - * gdas_enkf_update : about 20 seconds longer (6.4 for GFS v15.1 -vs- 6.7 for GFS v15.2) - - - -PRE-IMPLEMENTATION TESTING REQUIREMENTS - - * Which production jobs should be tested as part of this implementation? - * The entire GFS v15.2 package needs to be installed and tested. EMC can run the same date - and compare NCO and EMC output to confirm the EMC and NCO tests reproduce each other - - * Does this change require a 30-day evaluation? - * No. - - - * Suggested evaluators - * Please contact the following EMC staff for the indicated components - Fanglin.Yang@noaa.gov - MODEL - Russ.Treadon@noaa.gov - DA - Wen.Meng@noaa.gov - UPP - Yali.Mao@noaa.gov - WAFS - Boi.Vuong@noaa.gov - downstream products - - -DISSEMINATION INFORMATION - - * Where should this output be sent? - * No change from GFS v15.1 - - * Who are the users? - * No change from GFS v15.1 - - * Which output files should be transferred from PROD WCOSS to DEV WCOSS? - * No change from GFS v15.1 - - * Directory changes - * No change from GFS v15.1 - - * File changes. - * See SCN - - -HPSS ARCHIVE - - No change from GFS v15.1 - - - -JOB DEPENDENCIES & FLOW DIAGRAM - * No change from GFS v15.1 - - -=========== -Prepared by -Fanglin.Yang@noaa -Russ.Treadon@noaa.gov -Boi.Vuong@noaa.gov -Wen.Meng@noaa.gov - - diff --git a/docs/Release_Notes.gfs.v16.0.0.md b/docs/Release_Notes.gfs.v16.0.0.md deleted file mode 100644 index 19ce4e5600..0000000000 --- a/docs/Release_Notes.gfs.v16.0.0.md +++ /dev/null @@ -1,413 +0,0 @@ -GFS RELEASE NOTES (GFS.v16.0.0) -- October 9, 2020 - -------- -PRELUDE -------- - -* GFS version 16.0 is the first major upgrade to Finite Volume Cubed Sphere (FV3) dynamical core based GFS which replaced the spectral dynamical core in June 2019. In this upgrade, the number of model vertical layers is increased from 64 to 127 and the model top is extended from the upper stratosphere (~55 km height) to the mesopause (~80 km height). With this upgrade, for the first time, the operational stand alone global deterministic WAVEWATCH III based wave model Multi_1 (wave_multi_1.v3.3) is merged into the GFS system. The WAVEWATCH III model is updated and coupled to the GFS using a one-way coupling scheme where the atmospheric model provides forcing to the wave model using the NOAA Environmental Modeling System (NEMS). Major changes have also been made in other components of the forecast system including model physics, data assimilation, system infrastructure, post-processing and product generation. - -EMC has conducted a set of retrospective and real-time experiments, covering part of the 2018 hurricane season and the entire period from May 10, 2019 to the present, for a comprehensive evaluation of the model upgrades. GFSv16 showed improved forecast skills in many areas. For more details please refer to the Science Change Notice: https://docs.google.com/document/d/1pDLqP6ne2grEJ2vMfw7RnkwyzRsGpGPMb1d2DeDuu2E/edit. - -* GFS.v16 has been reorganized to use a COMPONENT directory structure to separate the atmos and wave components. - -* This release note describes the overall changes made to the entire system. More details about changes in science and structure of the data assimilation system are documented in gfs.v16.0.0/sorc/gsi.fd/doc/Release_Notes.gfsda.v16.0.0.txt. Details about downstream product generation is documented in Release_Notes.gfs_downstream.v16.0.0.txt. - ---------------------------- -IMPLEMENTATION INSTRUCTIONS ---------------------------- - -* The NOAA VLab and both the NOAA-EMC and NCAR organization spaces on GitHub.com are used to manage the GFS.v16 code. The SPA(s) handling the GFS.v16 implementation need to have permissions to clone VLab gerrit repositories and the private NCAR UPP_GTG repository. All NOAA-EMC organization repositories are publicly readable and do not require access permissions. Please contact Fanglin.Yang@noaa.gov if there is any VLAB access issue and/or the individual code managers listed under item #6) below. Please follow the following steps to install the package on WCOSS-Dell: - - 1) cd $NWROOTp3 - 2) mkdir gfs.v16.0.0 - 3) cd gfs.v16.0.0 - 4) git clone -b EMC-v16.0.0 https://github.com/NOAA-EMC/global-workflow.git . - 5) cd sorc - 6) ./checkout.sh -o - * This script extracts the following GFS components: - MODEL tag GFS.v16.0.13 Jun.Wang@noaa.gov - GSI tag gfsda.v16.0.0 Russ.Treadon@noaa.gov - GLDAS tag gldas_gfsv16_release.v1.11.0 Helin.Wei@noaa.gov - UFS_UTIL tag ops-gfsv16.0.0 George.Gayno@noaa.gov - POST tag upp_gfsv16_release.v1.1.0 Wen.Meng@noaa.gov - WAFS tag gfs_wafs.v6.0.9 Yali.Mao@noaa.gov - - 7) ./build_all.sh - *This script compiles all GFS components. Runtime output from the build for each package is written to log files in directory logs. To build an individual program, for instance, gsi, use build_gsi.sh. - - 8) ./link_fv3gfs.sh nco dell - - 9) Please use the script /gpfs/dell6/emc/modeling/noscrub/emc.glopara/para_gfs/misc/copyic_v16rt2_nco.sh on Mars to copy initial conditions from EMC real-time parallel v16rt2 to $COM directory to start NCO’s parallel from the dump step of next cycle. Please remember to change the COMROOT setting in this script to /gpfs/dell1/nco/ops/com. It will rsync v16rt2 data from the dev machine to either dev or prod machine. - -Instruction notes: ------------------- - -* The GSI build script ($HOMEgfs/sorc/build_gsi.sh) must be executed prior to $HOMEgfs/sorc/build_enkf_chgres_recenter_nc.sh. This automatically happens when executing $HOMEgfs/sorc/build_all.sh to build all GFS v16 executables. - -* The RTOFS curfile*h variable settings must be updated in scripts/exgfs_wave_prep.sh when the RTOFS implementation occurs. The “_1hrly” and “_3hrly” text will be removed to update the filenames: - - Before RTOFS implementation (current settings): - - curfile1h=${COMIN_WAV_CUR}/rtofs_glo_2ds_${fext}${fh3_rtofs}_1hrly_prog.nc - curfile3h=${COMIN_WAV_CUR}/rtofs_glo_2ds_${fext}${fh3_rtofs}_3hrly_prog.nc - - After RTOFS implementation: - - curfile1h=${COMIN_WAV_CUR}/rtofs_glo_2ds_${fext}${fh3_rtofs}_prog.nc - curfile3h=${COMIN_WAV_CUR}/rtofs_glo_2ds_${fext}${fh3_rtofs}_prog.nc - -* ecflow suite definition and scripts are saved in gfs.v16.0.0/ecflow/ecf - -* POST contains restricted GTG (Graphic Turbulence Guidance) code provided NCAR. Please do not post the GTG code in any public domain. - ------------ -JOB CHANGES ------------ - -Many job scripts have been added, removed or renamed to meet NCO script naming conventions for GFS.v16. - -Renamed job scripts are: - -* JGDAS_ENKF_RECENTER -> JGDAS_ENKF_ECEN -* JGDAS_GEMPAK -> JGDAS_ATMOS_GEMPAK -* JGDAS_GEMPAK_META -> JGDAS_ATMOS_GEMPAK_META_NCDC -* JGDAS_VMINMON -> JGDAS_ATMOS_VMINMON -* JGDAS_VERFRAD -> JGDAS_ATMOS_VERFRAD -* JGDAS_VERFOZN -> JGDAS_ATMOS_VERFOZN -* JGFS_AWIPS_20KM_1P0DEG -> JGFS_ATMOS_AWIPS_20KM_1P0DEG -* JGFS_AWIPS_G2 -> JGFS_ATMOS_AWIPS_G2 -* JGFS_CYCLONE_GENESIS -> JGFS_ATMOS_CYCLONE_GENESIS -* JGFS_CYCLONE_TRACKER -> JGFS_ATMOS_CYCLONE_TRACKER -* JGFS_FBWIND -> JGFS_ATMOS_FBWIND -* JGFS_GEMPAK -> JGFS_ATMOS_GEMPAK -* JGFS_GEMPAK_META -> JGFS_ATMOS_GEMPAK_META -* JGFS_GEMPAK_NCDC_UPAPGIF -> JGFS_ATMOS_GEMPAK_NCDC_UPAPGIF -* JGFS_GEMPAK_PGRB2_SPEC -> JGFS_ATMOS_GEMPAK_PGRB2_SPEC -* JGFS_PGRB2_SPEC_NPOESS -> JGFS_ATMOS_PGRB2_SPEC_NPOESS -* JGFS_POSTSND -> JGFS_ATMOS_POSTSND -* JGFS_VMINMON -> JGFS_ATMOS_VMINMON -* JGFS_WAFS -> JGFS_ATMOS_WAFS -* JGFS_WAFS_BLENDING -> JGFS_ATMOS_WAFS_BLENDING -* JGFS_WAFS_GCIP -> JGFS_ATMOS_WAFS_GCIP -* JGFS_WAFS_GRIB2 -> JGFS_ATMOS_WAFS_GRIB2 -* JGLOBAL_ANALYSIS -> JGLOBAL_ATMOS_ANALYSIS -* JGLOBAL_EMCSFC_SFC_PREP -> JGLOBAL_ATMOS_EMCSFC_SFC_PREP -* JGLOBAL_ENKF_SELECT_OBS -> JGDAS_ENKF_SELECT_OBS -* JGLOBAL_ENKF_UPDATE -> JGDAS_ENKF_UPDATE -* JGLOBAL_TROPCY_QC_RELOC -> JGLOBAL_ATMOS_TROPCY_QC_RELOC -* JGLOBAL_NCEPPOST -> JGLOBAL_ATMOS_NCEPPOST -* JGLOBAL_POST_MANAGER -> JGLOBAL_ATMOS_POST_MANAGER - -New job scripts are: - -* JGDAS_ATMOS_ANALYSIS_DIAG -* JGDAS_ATMOS_CHGRES_FORENKF -* JGDAS_ATMOS_GLDAS -* JGDAS_ENKF_DIAG -* JGDAS_ENKF_SFC -* JGFS_ATMOS_FSU_GENESIS -* JGFS_ATMOS_WAFS_GRIB2_0P25 -* JGFS_ATMOS_WAFS_BLENDING_0P25 -* JGLOBAL_ATMOS_ANALYSIS_CALC -* JGLOBAL_WAVE_GEMPAK -* JGLOBAL_WAVE_INIT -* JGLOBAL_WAVE_POST_BNDPNT -* JGLOBAL_WAVE_POST_PNT -* JGLOBAL_WAVE_POST_SBS -* JGLOBAL_WAVE_PRDGEN_BULLS -* JGLOBAL_WAVE_PRDGEN_GRIDDED -* JGLOBAL_WAVE_PREP - -Removed job scripts are: - -* JGDAS_BULLS_NAVY -* JGDAS_TROPC -* JGFS_FAX -* JGFS_FAX_WAFS -* JGLOBAL_ENKF_INNOVATE_OBS - --------------- -SCRIPT CHANGES --------------- - -Many scripts have been added, removed or renamed to meet NCO script naming conventions for GFS.v16. - -Renamed scripts are: - -* exemcsfc_global_sfc_prep.sh.ecf -> exemcsfc_global_sfc_prep.sh -* exgdas_nawips.sh.ecf -> exgdas_atmos_nawips.sh -* exgdas_nceppost.sh.ecf -> exgdas_atmos_nceppost.sh -* exgdas_vrfminmon.sh.ecf -> exgdas_atmos_vminmon.sh -* exgdas_vrfyrad.sh.ecf -> exgdas_atmos_verfrad.sh -* exgdas_vrfyozn.sh.ecf -> exgdas_atmos_verfozn.sh -* exgempak_gdas_gif_ncdc.sh.ecf -> exgdas_atmos_gempak_gif_ncdc.sh -* exgempak_gfs_gif_ncdc_skew_t.sh.ecf -> exgfs_atmos_gempak_gif_ncdc_skew_t.sh -* exgfs_awips_20km_1p0deg.sh.ecf -> exgfs_atmos_awips_20km_1p0deg.sh -* exgfs_fbwind.sh.ecf -> exgfs_atmos_fbwind.sh -* exgfs_gempak_meta.sh.ecf -> exgfs_atmos_gempak_meta.sh -* exgfs_grib_awips.sh.ecf -> exgfs_atmos_grib_awips.sh -* exgfs_nawips.sh.ecf -> exgfs_atmos_nawips.sh -* exgfs_nceppost.sh.ecf -> exgfs_atmos_nceppost.sh -* exgfs_pmgr.sh.ecf -> exgfs_pmgr.sh -* exgfs_postsnd.sh.ecf -> exgfs_atmos_postsnd.sh -* exgfs_prdgen_manager.sh.ecf -> exgfs_prdgen_manager.sh -* exgfs_vrfminmon.sh.ecf -> exgfs_atmos_vminmon.sh -* exgfs_wafs_blending.sh.ecf -> exgfs_atmos_wafs_blending.sh -* exgfs_wafs_gcip.sh.ecf -> exgfs_atmos_wafs_gcip.sh -* exgfs_wafs_grib.sh.ecf -> exgfs_atmos_wafs_grib.sh -* exgfs_wafs_grib2.sh.ecf -> exgfs_atmos_wafs_grib2.sh -* exglobal_analysis_fv3gfs.sh.ecf -> exglobal_atmos_analysis.sh -* exglobal_enkf_fcst_fv3gfs.sh.ecf -> exgdas_enkf_fcst.sh -* exglobal_enkf_recenter_fv3gfs.sh.ecf -> exgdas_enkf_ecen.sh -* exglobal_enkf_post_fv3gfs.sh.ecf -> exgdas_enkf_post.sh -* exglobal_enkf_update_fv3gfs.sh.ecf -> exgdas_enkf_update.sh -* exglobal_fcst_nemsfv3gfs.sh -> exglobal_forecast.sh -* exglobal_grib2_special_npoess.sh.ecf -> exgfs_atmos_grib2_special_npoess.sh -* exglobal_innovate_obs_fv3gfs.sh.ecf -> exgdas_enkf_select_obs.sh -* exglobal_pmgr.sh.ecf -> exglobal_atmos_pmgr.sh -* exgoes_nawips.sh.ecf -> exgfs_atmos_goes_nawips.sh -* exnawips.sh.ecf -> exgfs_atmos_nawips.sh -* extropcy_qc_reloc.sh.ecf -> exglobal_atmos_tropcy_qc_reloc.sh - -New scripts are: - -* exgdas_atmos_gldas.sh -* exgdas_enkf_sfc.sh -* exgfs_atmos_wafs_grib2_0p25.sh -* exgfs_atmos_wafs_blending_0p25.sh -* exgfs_wave_init.sh -* exgfs_wave_nawips.sh -* exgfs_wave_post_bndpnt.sh -* exgfs_wave_post_gridded_sbs.sh -* exgfs_wave_post_pnt.sh -* exgfs_wave_prdgen_bulls.sh -* exgfs_wave_prdgen_gridded.sh -* exgfs_wave_prep.sh -* exgdas_atmos_chgres_forenkf.sh -* exglobal_atmos_analysis_calc.sh -* exglobal_diag.sh - -Removed scripts are: - -* exgdas_bulls_navy.sh.ecf -* exgdas_tropc.sh.ecf -* exgfs_fax.sh.ecf -* exgfs_fax_wafs.sh.ecf -* exgfs_grib_awips_g2.sh.ecf -* exgfs_grib_wafs.sh.ecf - -------------------- -PARM/CONFIG CHANGES -------------------- - -All JJOBS except for those used by downstream product generation source config files under ./gfs.v16.0.0/parm/config to set up job-specific parameters. The config.base is sourced by all JJOBS to set parameters that are common to either all JJOBS or are shared by more than one JJOBS. The config.anal is shared by a few analysis steps, config.wave is shared by the wave steps, and config.wafs is shared by the WAFS jobs. Below are the parm (config) files modified or added in GFS.v16. - -Modified configs: - -* config.anal -* config.arch -* config.awips -* config.base.emc.dyn -* config.base.nco.static -* config.earc -* config.ecen -* config.efcs -* config.eobs -* config.epos -* config.eupd -* config.fcst -* config.fv3 -* config.fv3ic -* config.gempak -* config.post -* config.postsnd -* config.prep -* config.prepbufr -* config.resources -* config.vrfy - -New configs: - -* config.analcalc -* config.analdiag -* config.echgres -* config.ediag -* config.esfc -* config.gldas -* config.metp -* config.wafs -* config.wafsblending -* config.wafsblending0p25 -* config.wafsgcip -* config.wafsgrib2 -* config.wafsgrib20p25 -* config.wave -* config.waveawipsbulls -* config.waveawipsgridded -* config.wavegempak -* config.waveinit -* config.wavepostbndpnt -* config.wavepostpnt -* config.wavepostsbs -* config.waveprep - ------------ -FIX CHANGES ------------ - -* All fixed fields used by the system are placed under gfs.v16.0.0/fix, and further categorized based on the type of applications. During the NCO implementation process the fix_gsi and wafs fix files are copied from external repositories via sorc/checkout.sh and linked under /fix via sorc/link_fv3gfs.sh. All other fix files are copied from EMC's local archives via sorc/link_fv3gfs.sh: fix_am, fix_fv3_gmted2010, fix_gldas, fix_orog, fix_verif, fix_wave_gfs - -The entire package takes 165 GB disk space to install. This ./fix directory alone takes ~153G. - -New fix files: - -* fix_am - new solar constants, Thompson MP climatology, salinity climatology -* fix_fv3_gmted2010 - new fix_sfc subfolder -* fix_gldas - new folder with files for GLDAS package -* fix_orog - new global lake files -* fix_verif - new grid2obs files -* fix_wave_gfs - new folder with files for wave component - ---------------- -PRODUCT CHANGES ---------------- - -* Please refer to GFSv16 SCN: https://docs.google.com/document/d/1pDLqP6ne2grEJ2vMfw7RnkwyzRsGpGPMb1d2DeDuu2E/edit - --------------------- -RESOURCE INFORMATION --------------------- - -* Frequency of run - 6 hourly cycle (00, 06, 12, 18Z) - no change from current operations - -* Commonly used libraries, compiler, and modules are defined in gfs.v16.0.0/modulefiles. For FV3, GSI, GLDAS, UPP, WAFS they maintain their own module files under gfs.v16.0.0/sorc/(fv3gfs gsi gldas gfs_post gfs_wafs).fd/modulefiles - -* Data retention time under $COMROOTp3 for GFS.v16 should be the same as GFS.v15. - -* Disk space: The current operational GFS.v15 takes about 10.7 TB online COM disk space per cycle, while GFS.v16 will require about 8.0 TB per cycle. - -* Computational resources and run times: - - * Please refer to the following document for the details of node usage,threading, and walltimes set in ECFLOW job cards for all jobs: - https://docs.google.com/spreadsheets/d/1XAa5mDWLQJSMgyxhR8W7RRuENJN7koJN-rIHLkTgieo/edit#gid=0 - - * Please refer to the following document for the high watermark test results for the overall computational cost of the system: - https://docs.google.com/presentation/d/1aNi5doryHO_lNhtTq-jGzFh9Wi4Xu1Z5DNb921nhw74/edit#slide=id.ga069802256_0_377 - -* Information about the major steps and actual runtimes from EMC high watermark tests are listed below: - - * JGLOBAL_FORECAST (GFS) - * 484 nodes, 3388 tasks, ptile=7, 4 threads/task - * Runtime: 125 minutes - - * JGLOBAL_FORECAST (GDAS) - * 119 nodes, 833 tasks, ptile=7, 4 threads/task - * Runtime: 22 minutes - - * JGLOBAL_ATMOS_ANALYSIS (GFS) - * 250 nodes, 1000 tasks, ptile=4, 7 threads/task - * Runtime: 29 minutes - - * JGLOBAL_ATMOS_ANALYSIS (GDAS) - * 250 nodes, 1000 tasks, ptile=4, 7 threads/task - * Runtime: 38 minutes - - * JGDAS_ENKF_SELECT_OBS - * 120 nodes, 480 tasks, ptile=4, 7 threads/task - * Runtime: 3.8 minutes - - * JGDAS_ENKF_UPDATE - * 240 nodes, 960 tasks, ptile=4, 7 threads/task - * Runtime: 26 minutes - - * JGDAS_ENKF_ECEN - * 20 nodes, 80 tasks, ptile=4, 7 threads/task - * Runtime: 4.4 minutes per realization - * Concurrently run 3 realizations of JGDAS_ENKF_ECEN. Total node usage for 3 jobs x 20 nodes each = 60 nodes. - - * JGDAS_ENKF_FCST - * 15 nodes, 420 tasks, ptile=28, 1 threads/task - * Runtime: 29 minutes per realization - * Concurrently run 40 realizations of JGDAS_ENKF_FCST. Each job processes 2 EnKF - members. Total node usage for 40 jobs x 15 nodes each = 600 nodes - * 40 EnKF forecast groups for GFS.v16 is an increase from the 20 EnKF forecast groups - currently run in operations. - - * JGDAS_ENKF_POST - * 20 nodes, 80 tasks, ptile=4, 7 threads/task - * Runtime: 11 minutes per realization - * Concurrently run 7 realizations of JGDAS_ENKF_POST. 7 forecasts processed, one - per job. Total node usage for 7 jobs x 20 nodes each = 140 nodes. - ---------------------------------------- -PRE-IMPLEMENTATION TESTING REQUIREMENTS ---------------------------------------- - -* Which production jobs should be tested as part of this implementation? - * All components of this package need to be tested. EMC is running a real-time parallel using the same system. We will work with the SPA to provide initial conditions from this parallel to run the NCO parallel during the implementation process. We will compare results from EMC and NCO parallels to ensure they reproduce each other. - -* Does this change require a 30-day evaluation? - * Yes, the entire GFS.v16 package requires a 30-day evaluation - -* Suggested evaluators - * Please contact fanglin.yang@noaa.gov, russ.treadon@noaa.gov, and kate.friedman@noaa.gov for evaluation. - -------------------------- -DISSEMINATION INFORMATION -------------------------- - -* Where should this output be sent? - * Please refer to GFSv16 SCN. Additionally, we have sent a request to NCO Dataflow to start sending new files WAFS_0p25_blended_YYYYMMDDHHfFF.grib2 to AWC only. - -* Who are the users? - * same as current operations plus multi_1 users - -* Which output files should be transferred from PROD WCOSS to DEV WCOSS? - * Same as current operational gfs, plus wave products. As there are certain changes in product names and types, EMC will provide support for NCO dataflow team to finalize the list.The amount of data to be transferred also depends on NCO’s network bandwidth. - -* Directory changes - - * Add $COMPONENT subfolder to gfs, gdas, and enkf paths for atmospheric component underneath the $cyc folder: - - $COMROOTp3/gfs/prod/gfs.$PDY/$cyc/atmos - $COMROOTp3/gfs/prod/gdas.$PDY/$cyc/atmos - $COMROOTp3/gfs/prod/enkf.gdas.$PDY/$cyc/atmos/memXXX - - * Introduce wave model via $COMPONENT subfolder under gfs and gfs $cyc folders: - - $COMROOTp3/gfs/prod/gfs.$PDY/$cyc/wave - $COMROOTp3/gfs/prod/gdas.$PDY/$cyc/wave - -* File changes - - * The UPP(post) file changes can be referred to: - https://docs.google.com/spreadsheets/d/1I-nqfVO67qE3uHah1p9UNbBPgcStXptEj91MBucSTb4/edit?usp=sharing - ------------- -HPSS ARCHIVE ------------- - -Please refer to the following document for current operational GFS.v15 archives and the proposed archives for GFS.v16: -https://docs.google.com/spreadsheets/d/1KkyXa-ZyWCjKul_kijUM4241VBzAerMifMOShLy0crY/edit#gid=0 - -Please check WCOSS /gpfs/dell1/nco/ops/nwprod/runhistory.v2.3.2/parm/gfs to see a full list of GFS.v15 files archived in HPSS tape. - -------------------------------- -JOB DEPENDENCIES & FLOW DIAGRAM -------------------------------- - -GDAS and GFS flowchart (downstream jobs compressed): -https://docs.google.com/presentation/d/1grydJSn3LxNishdHOxwOQMyxkLsEzlIfj1PHiTUrAkE/edit#slide=id.g6ee6c85d17_0_0 - -=========== -Prepared by -Kate.Friedman@noaa.gov -Fanglin.Yang@noaa.gov -Russ.Treadon@noaa.gov -Jun.Wang@noaa.gov -Helin.Wei@noaa.gov -George.Gayno@noaa.gov -Wen.Meng@noaa.gov -Yali.Mao@noaa.gov -Jessica.Meixner@noaa.gov -=========== diff --git a/docs/Release_Notes.gfs.v16.1.0.txt b/docs/Release_Notes.gfs.v16.1.0.txt deleted file mode 100644 index 82960aee09..0000000000 --- a/docs/Release_Notes.gfs.v16.1.0.txt +++ /dev/null @@ -1,193 +0,0 @@ -GFS V16.1.0 RELEASE NOTES - - -PRELUDE - - NOAA awarded Delivery Order 2 (DO-2) of its commercial radio occultation (RO) - data purchase to GeoOptics on February 19, 2021. This purchase covers 1300 - occultations a day over a six month period with the data flow starting on - March 17, 2021. - - The quality of the GeoOptics occultations was examined during Delivery - Order 1 (DO-1) in December 2020 and January 2021. Forecast impact assessment - was conducted using half resolution parallels in the GFSv16 framework. - - Testing of the DO-2 data is being carried out using a real time full - resolution parallel, v161rt1. It was initially started in mid-February - to test reproducibility with the GFSv16 NCO parallel, then adjusted to reduce - computational footprint. Data from GeoOptics began to be assimilated as soon - as it was available on March 17. Configuration for the use of the commercial - data was informed by the results of DO-1 experimentation, with the quality - control and observation errors being treated as other RO data with the - exception of lowering the upper bound of data. - - This package also addresses several GFS v16 bugzilla tickets. GFS v16 - bugzilla tickets #1196 and #1205 are resolved in this package. The error - reported in bugzilla ticket #1206 has been documented to be compiler, not - code, specific. The DA aspect of GFS v16 bugzilla tickets #216, #1198, #1218, - #1221, and #1222 are also addressed by this package. None of the DA - bugzilla changes alter analysis results. - - GFSv16 introduced a bug where the sign of the layer height (delz) increment - was flipped. The included bugfix reverts the sign as originally intended. - This fix was tested in both a low resolution setting and with a full - resolution parallel, v16rt2c. Once v16rt2c was seen as viable, it also - began assimilating the GeoOptics data so both changes were tested in one - package. - - There are several wave related fixes being included in this update: - * Including the RW-NH* boundary points which are used in NHC's - offline NWPS system were removed from multi_1 to GFSv16, which - also requires a minor script bug fix. - * Fix the interpolation to the East Pacific wave grid to include - all of the American Samoa islands. - * Unmask the Gulf of California, Red Sea and Persian Gulf in the - global 0p25 interpolated wave output grid. - - -CHANGES TO RESOURCES AND FILE SIZES - - Impact of including RW-NHC points is: There should be no impact to the - forecast job timing, however the *wave.out_pnt.points* files in the - wave/rundata com directories will each increase in size by 6MB. The - JGLOBAL_WAVE_POST_BNDPNTBLL and JGLOBAL_WAVE_POST_BNDPNT will now take - approximately 20 minutes longer. The gfswave.tZZz.ibpbull_tar will - increase in size to be 78M, gfswave.tZZz.ibpcbull_tar will now be 42M - and the gfswave.tZZz.ibp_tar file will now be 11 GB. - - Impact of East Pacific and global 0p25 wave grid fixes: There are no - impacts in terms of resources or file size. - - -IMPLEMENTATION INSTRUCTIONS - - The NOAA VLab and both the NOAA-EMC and NCAR organization spaces on GitHub.com - are used to manage the GFS.v16.1 code. The SPA(s) handling the GFS.v16.1 - implementation need to have permissions to clone VLab gerrit repositories and - the private NCAR UPP_GTG repository. All NOAA-EMC organization repositories are - publicly readable and do not require access permissions. Please follow the - following steps to install the package on WCOSS-Dell: - - 1) cd $NWROOTp3 - - 2) mkdir gfs.v16.1.0 - - 3) cd gfs.v16.1.0 - - 4) git clone -b EMC-v16.1.0 https://github.com/NOAA-EMC/global-workflow.git . - - 5) cd sorc - - 6) ./checkout.sh -o - * This script extracts the following GFS components: - MODEL tag GFS.v16.0.16 Jun.Wang@noaa.gov - GSI tag gfsda.v16.1.0 Russ.Treadon@noaa.gov - GLDAS tag gldas_gfsv16_release.v1.12.0 Helin.Wei@noaa.gov - UFS_UTILS tag ops-gfsv16.0.0 George.Gayno@noaa.gov - POST tag upp_gfsv16_release.v1.1.3 Wen.Meng@noaa.gov - WAFS tag gfs_wafs.v6.0.21 Yali.Mao@noaa.gov - - 7) ./build_all.sh - * This script compiles all GFS components. Runtime output from the build for - each package is written to log files in directory logs. To build an - individual program, for instance, gsi, use build_gsi.sh. - - 8) ./link_fv3gfs.sh nco dell - - -SORC CHANGES - -* sorc/ - * checkout.sh will checkout the following changed model tags: - * MODEL; tag GFS.v16.0.16 - There are no changes in this tag - compared to operations. The tag number was updated from - tag GFS.v16.0.15 to incorporate the local changes made in operations. - - * GSI; tag gfsda.v16.1.0 - See release notes - doc/Release_Notes.gfsda.v16.1.0.txt in the GSI tag for details. - - * POST; tag upp_gfsv16_release.v1.1.3 - There are no changes in this tag - compared to operations. The tag number was updated from - tag upp_gfsv16_release.v1.1.1 to incorporate the local changes made - in operations. - - * WAFS; tag gfs_wafs.v6.0.21 - There are no changes in this tag compared to - operations. The tag number was updated from gfs_wafs.v6.0.17 to - incorporate the local changes made in operations. - - -JOBS CHANGES - -* No change from GFS v16.0 - - -PARM/CONFIG CHANGES - -* No change from GFS v16.0 - - -SCRIPT CHANGES - -* There is one bug fix for waves that is a script change in scripts/exgfs_wave_post_pnt.sh - to ensure all point output is created (for example for the RW-NH* points). - - -FIX CHANGES - -* The contents of fix/fix_gsi have been updated. See release notes - doc/Release_Notes.gfsda.v16.1.0.txt in the NOAA-EMC/GSI tag gfsda.v16.1.0 - for details. - -* For the wave fix to include the RW-NH-* boundary points for the wave - point output, the following two fix files can be copied to the - fix/fix_wave_gfs folder: - /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_wave_gfs_v16.1.1/wave_gfs.buoys - /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_wave_gfs_v16.1.1/wave_gfs.buoys.full - - -* For the wave fix to the East Pacific wave grid interpolation the following - fix file with fix can be copied to the fix/fix_wave_gfs folder: - /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_wave_gfs_v16.1.1/ep_10m_interp.inp.tmpl - -* For the wave fix to include the Gulf of California, Red Sea, and Persian Gulf - the following to fix files need to be copied to the fix/fix_wave_gfs folder: - /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_wave_gfs_v16.1.1/ww3_grid.inp.glo_15mxt - /gpfs/dell2/emc/modeling/noscrub/emc.glopara/git/fv3gfs/fix_wave_gfs_v16.1.1/WHTGRIDINT.bin.glo_15mxt - - -PRE-IMPLEMENTATION TESTING REQUIREMENTS - -* Which production jobs should be tested as part of this implementation? - * The entire GFS v16.1 package needs to be installed and tested. - -* Does this change require a 30-day evaluation? - * No. - - -DISSEMINATION INFORMATION - -* Where should this output be sent? - * No change from GFS v16.0 - -* Who are the users? - * No change from GFS v16.0 - -* Which output files should be transferred from PROD WCOSS to DEV WCOSS? - * No change from GFS v16.0 - -* Directory changes - * No change from GFS v16.0 - -* File changes - * No change from GFS v16.0 - - -HPSS ARCHIVE - -* No change from GFS v16.0 - - -JOB DEPENDENCIES AND FLOW DIAGRAM - -* No change from GFS v16.0 - diff --git a/docs/Release_Notes.gfs_downstream.v15.2.0.txt b/docs/Release_Notes.gfs_downstream.v15.2.0.txt deleted file mode 100644 index b1de8d6649..0000000000 --- a/docs/Release_Notes.gfs_downstream.v15.2.0.txt +++ /dev/null @@ -1,104 +0,0 @@ -RELEASE NOTES: GFS.v15.2.0 downstream products - released October 19, 2019 (tentative date) - -CODE CHANGES - No code change - -JOB CHANGES - The followig jobs (J-job) have been removed from GFS v15.2.0 - - JGFS_FAX (retired in June 12, 2019) - - JGFS_FAX_WAFS (retired in June 12, 2019) - - JGDAS_TROPC (NCO approved to remove in GFS V15.2.0) - - The remain GFS downstream jobs are below: - - JGDAS_GEMPAK - - JGDAS_GEMPAK_META_NCDC - - JGFS_AWIPS_G2 - - JGFS_FBWIND - - JGFS_GEMPAK - - JGFS_GEMPAK_META - - JGFS_PGRB2_SPEC_GEMPAK - - JGFS_AWIPS_20KM_1P0DEG - - JGFS_GEMPAK_NCDC_UPAPGIF - - JGFS_PGRB2_SPEC_NPOESS - - JGDAS_BULLS_NAVY - - All Job cards have same setting for testing on DELL with real-time GFS v15.2 data. - ( An example: JGFS_GEMPAK ) - # LSBATCH: User input - #BSUB -J gfs_gempak_00 - #BSUB -o /gpfs/dell2/ptmp/Boi.Vuong/output/gfs_gempak_00.o%J - #BSUB -q debug - #BSUB -cwd /gpfs/dell2/ptmp/Boi.Vuong/output - #BSUB -W 00:30 - #BSUB -P GFS-T2O - #BSUB -n 24 # 24 tasks - #BSUB -R span[ptile=12] # 12 task per node - #BSUB -R affinity[core(1):distribute=balance] # using 12 cores on node and bind to 1 - # core per task and distribute across sockets - - #################################### - ## Load the GRIB Utilities modules - #################################### - module load EnvVars/1.0.2 - module load ips/18.0.1.163 - module load CFP/2.0.1 - module load impi/18.0.1 - module load lsf/10.1 - module load prod_util/1.1.3 - module load prod_envir/1.0.3 - module load grib_util/1.1.0 - ########################################### - # Now set up GEMPAK/NTRANS environment - ########################################### - module load gempak/7.3.1 - module list - -FV3 GFS DRIVER: - All drivers are used to test GFS downtream jobs in gfs.v15.2.0/driver/product/run_*_dell.sh_xx where is xx is cycle - -The followig jobs, scripts, parm have been modified to meet NCO - EE2 implementation standards. -JOB CHANGES - JGDAS_BULLS_NAVY -removed dependencies for gempak on phase 1 - JGDAS_GEMPAK -removed dependencies for gempak on phase 1 - JGDAS_GEMPAK_META_NCDC - JGFS_AWIPS_20KM_1P0DEG - JGFS_AWIPS_G2 - JGFS_FBWIND - JGFS_GEMPAK -removed dependencies for gempak on phase 1 - JGFS_GEMPAK_META -removed dependencies for gempak on phase 1 - JGFS_GEMPAK_NCDC_UPAPGIF -removed dependencies for gempak on phase 1 - JGFS_PGRB2_SPEC_GEMPAK -removed dependencies for gempak on phase 1 - JGFS_PGRB2_SPEC_NPOESS - -SCRIPTS CHANGES - exgdas_bulls_navy.sh.ecf -removed dependencies for sstoi_grb on phase 1 - exgdas_nawips.sh.ecf -removed dependencies for gempak on phase 1 - exgempak_gdas_gif_ncdc.sh.ecf -removed dependencies for gempak on phase 1 - exgempak_gfs_gif_ncdc_skew_t.sh.ecf -removed dependencies for gempak on phase 1 - exgfs_awips_20km_1p0deg.sh.ecf - exgfs_fbwind.sh.ecf - exgfs_gempak_meta.sh.ecf -removed dependencies for gempak on phase 1 - exgfs_grib_awips_g2.sh.ecf - exgfs_grib_awips.sh.ecf - exgfs_nawips.sh.ecf -removed dependencies for gempak on phase 1 - exglobal_grib2_special_npoess.sh.ecf - exgoes_nawips.sh.ecf -removed dependencies for gempak on phase 1 - exnawips.sh.ecf -removed dependencies for gempak on phase 1 - -PARM CHANGES - No changes in parm cards for AWIPS products from GFS v15.1 - -USH CHANGES - mkbull_ntc.sh -removed dependencies for sstoi_grb on phase 1 - -GEMPAK CHANGES - -Adding the diretory dictionaries -removed dependencies for gempak on phase 1 - (Note: This directory comes from phase 1) - - All gempak's USH and FIX have been modified to remove all dependencies on Phase I - -ECFLOW CHANGES - -Removed GFS FAX, GFS FAX WAFS and GDAS_TROPC in ecflow suite definition and scripts - -=========== -Prepared by -Boi.Vuong@noaa.gov diff --git a/docs/Release_Notes.gfs_downstream.v16.0.0.txt b/docs/Release_Notes.gfs_downstream.v16.0.0.txt deleted file mode 100644 index 5ee6238b9d..0000000000 --- a/docs/Release_Notes.gfs_downstream.v16.0.0.txt +++ /dev/null @@ -1,114 +0,0 @@ -RELEASE NOTES: GFS.v16.0.0 downstream products - released March 31, 2020 (tentative date) - -CODE CHANGES - No code change - -AWIPS CHANGES - Removed field "5WAVH" in All parm crads for AWIPS 20km and 1.0 deg (UPP planed to remove in GFS v16.0) - -GEMPAK CHANGES - Removed simulated GOES 12/13 in GEMPAK and PGRB2 - Added simulated GOES 16/17 in GEMPAK and PGRB2 in LAT/LON 0.25 deg - -JOB CHANGES - - Removed JGDAS_BULLS_NAVY - to be retired in GFS V16.0 - - Removed JGDAS_TROPC - Rteired in GFS v15.2.0 - - The remain GFS downstream jobs are following: - - JGDAS_ATMOS_GEMPAK - - JGDAS_ATMOS_GEMPAK_META_NCDC - - JGFS_ATMOS_AWIPS_G2 - - JGFS_ATMOS_FBWIND - - JGFS_ATMOS_GEMPAK - - JGFS_ATMOS_GEMPAK_META - - JGFS_ATMOS_GEMPAK_PGRB2_SPEC - - JGFS_ATMOS_AWIPS_20KM_1P0DEG - - JGFS_ATMOS_GEMPAK_NCDC_UPAPGIF - - JGFS_ATMOS_PGRB2_SPEC_NPOESS - -SCRIPTS CHANGES - The following script have been removed from GFS v16.0.0 - - exgfs_grib_awips_g2.sh.ecf (retired in June 12, 2019) - - exgdas_bulls_navy.sh.ecf (Plan to retire in GFSS v16.0.0) GDAS and NAVY bulletins - - Removed WINTEMV bulltin in script exgfs_atmos_fbwind.sh (WINTEMV bulletin plan to retire in GFS v16.0.0) - -PARM/wmo - - Removed parm in grid 160,161,213,254,225 -----> Retired in GFS v15.2.7 - --DRIVER - All Job cards have same setting for testing on DELL with real-time GFS v15.2 data. - ( An example: JGFS_ATMOS_GEMPAK ) - # LSBATCH: User input - #BSUB -J gfs_gempak_00 - #BSUB -o /gpfs/dell2/ptmp/Boi.Vuong/output/gfs_gempak_00.o%J - #BSUB -q debug - #BSUB -cwd /gpfs/dell2/ptmp/Boi.Vuong/output - #BSUB -W 00:30 - #BSUB -P GFS-DEV - #BSUB -n 24 # 24 tasks - #BSUB -R span[ptile=12] # 12 task per node - #BSUB -R affinity[core(1):distribute=balance] # using 12 cores on node and bind to 1 - # core per task and distribute across sockets - - #################################### - ## Load the GRIB Utilities modules - #################################### - module load EnvVars/1.0.2 - module load ips/18.0.1.163 - module load CFP/2.0.1 - module load impi/18.0.1 - module load lsf/10.1 - module load prod_util/1.1.4 - module load prod_envir/1.0.3 - module load grib_util/1.1.0 - ########################################### - # Now set up GEMPAK/NTRANS environment - ########################################### - module load gempak/7.3.3 - module list - -FV3 GFS DRIVER: - All drivers are used to test GFS downtream jobs in gfs.v16.0.0/driver/product/run_*_dell.sh_xx where is xx is cycle - -The followig jobs, scripts, parm have been modified to meet NCO - EE2 implementation standards. -JOB CHANGES (no changes) - JGDAS_ATMOS_GEMPAK - JGDAS_ATMOS_GEMPAK_META_NCDC - JGFS_ATMOS_AWIPS_G2 - JGFS_ATMOS_FBWIND - JGFS_ATMOS_GEMPAK - JGFS_ATMOS_GEMPAK_META - JGFS_ATMOS_GEMPAK_PGRB2_SPEC - JGFS_ATMOS_AWIPS_20KM_1P0DEG - JGFS_ATMOS_GEMPAK_NCDC_UPAPGIF - JGFS_ATMOS_PGRB2_SPEC_NPOESS - -SCRIPTS CHANGES - exgdas_atmos_nawips.sh - exgdas_atmos_gempak_gif_ncdc.sh - exgfs_atmos_gempak_gif_ncdc_skew_t.sh - exgfs_atmos_awips_20km_1p0deg.sh - exgfs_atmos_fbwind.sh - exgfs_atmos_gempak_meta.sh - exgfs_atmos_grib_awips.sh - exgfs_atmos_nawips.sh - exgFS_atmos_grib2_special_npoess.sh - exgfs_atmos_goes_nawips.sh -removed dependencies for gempak on phase 1 - exgfs_atmos_nawips.sh -removed dependencies for gempak on phase 1 - -PARM CHANGES - Removed 5WAVH in parm cards for AWIPS products in GFS v16.0.0 - (NCEP POST stopped producing 5WAVH (plan to retire "5WAVH") in GFS v16.0.0 - -USH CHANGES - No changes - -GEMPAK CHANGES - - Added nagrib.tbl file in gempak's FIX directory - -ECFLOW CHANGES - -Removed GFS FAX, GFS FAX WAFS and GDAS_TROPC in ecflow suite definition and scripts - -=========== -Prepared by -Boi.Vuong@noaa.gov diff --git a/gempak/ush/gdas_ukmet_meta_ver.sh b/gempak/ush/gdas_ukmet_meta_ver.sh index dcc350ea74..845fa1cc6b 100755 --- a/gempak/ush/gdas_ukmet_meta_ver.sh +++ b/gempak/ush/gdas_ukmet_meta_ver.sh @@ -139,8 +139,7 @@ for area in $areas sdatenum=$sdate9 cyclenum=$cycle9 fi - # JY grid="$COMROOT/nawips/${envir}/ukmet.20${sdatenum}/ukmet_20${sdatenum}${cyclenum}${dgdattim}" - grid="${COMINukmet}.20${sdatenum}/ukmet_20${sdatenum}${cyclenum}${dgdattim}" + grid="${COMINukmet}.20${sdatenum}/gempak/ukmet_20${sdatenum}${cyclenum}${dgdattim}" # 500 MB HEIGHT METAFILE diff --git a/gempak/ush/gfs_meta_comp.sh b/gempak/ush/gfs_meta_comp.sh index 4e9a3d8820..9bd27c5736 100755 --- a/gempak/ush/gfs_meta_comp.sh +++ b/gempak/ush/gfs_meta_comp.sh @@ -217,8 +217,7 @@ export err=$?;err_chk done # COMPARE THE 1200 UTC GFS MODEL TO THE 0000 UTC UKMET MODEL grid="F-${MDL} | ${PDY2}/${cyc}00" - # JY export HPCUKMET=$COMROOT/nawips/prod/ukmet.${PDY} - export HPCUKMET=${COMINukmet}.${PDY} + export HPCUKMET=${COMINukmet}.${PDY}/gempak grid2="F-UKMETHPC | ${PDY2}/0000" # for gfsfhr in 00 12 24 36 48 60 84 108 for gfsfhr in 00 12 24 84 108 @@ -593,8 +592,7 @@ export err=$?;err_chk done # COMPARE THE 0000 UTC GFS MODEL TO THE 1200 UTC UKMET FROM YESTERDAY grid="F-${MDL} | ${PDY2}/${cyc}00" - #XXW export HPCUKMET=${MODEL}/ukmet.${PDYm1} - export HPCUKMET=${COMINukmet}.${PDYm1} + export HPCUKMET=${COMINukmet}.${PDYm1}/gempak grid2="F-UKMETHPC | ${PDY2m1}/1200" # for gfsfhr in 00 12 24 36 48 60 84 108 for gfsfhr in 00 12 24 84 108 diff --git a/gempak/ush/gfs_meta_crb.sh b/gempak/ush/gfs_meta_crb.sh index 4800578238..82fa7795e8 100755 --- a/gempak/ush/gfs_meta_crb.sh +++ b/gempak/ush/gfs_meta_crb.sh @@ -260,11 +260,8 @@ export err=$?;err_chk if [ ${cyc} -eq 00 ] ; then - # BV export MODEL=/com/nawips/prod - # JY export HPCECMWF=${MODEL}/ecmwf.${PDY} - # JY export HPCUKMET=${MODEL}/ukmet.${PDYm1} export HPCECMWF=${COMINecmwf}.${PDY}/gempak - export HPCUKMET=${COMINukmet}.${PDYm1} + export HPCUKMET=${COMINukmet}.${PDYm1}/gempak grid1="F-${MDL} | ${PDY2}/${cyc}00" grid2="${COMINecmwf}.${PDYm1}/gempak/ecmwf_glob_${PDYm1}12" grid3="F-UKMETHPC | ${PDY2m1}/1200" diff --git a/gempak/ush/gfs_meta_hur.sh b/gempak/ush/gfs_meta_hur.sh index 9590f07b3e..aed25d6d78 100755 --- a/gempak/ush/gfs_meta_hur.sh +++ b/gempak/ush/gfs_meta_hur.sh @@ -338,7 +338,7 @@ if [ ${cyc} -eq 00 ] ; then # JY export HPCECMWF=${MODEL}/ecmwf.${PDY} # JY export HPCUKMET=${MODEL}/ukmet.${PDY} export HPCECMWF=${COMINecmwf}.${PDY}/gempak - export HPCUKMET=${COMINukmet}.${PDY} + export HPCUKMET=${COMINukmet}.${PDY}/gempak grid1="F-${MDL} | ${PDY2}/${cyc}00" grid2="${COMINecmwf}.${PDYm1}/gempak/ecmwf_glob_${PDYm1}12" grid3="F-UKMETHPC | ${PDY2}/${cyc}00" diff --git a/gempak/ush/gfs_meta_mar_comp.sh b/gempak/ush/gfs_meta_mar_comp.sh index d7262814b5..a55fa3c642 100755 --- a/gempak/ush/gfs_meta_mar_comp.sh +++ b/gempak/ush/gfs_meta_mar_comp.sh @@ -181,7 +181,7 @@ export err=$?;err_chk done # COMPARE THE 1200 UTC GFS MODEL TO THE 0000 UTC UKMET MODEL grid="F-${MDL} | ${PDY2}/${cyc}00" - export HPCUKMET=${COMINukmet}.${PDY} + export HPCUKMET=${COMINukmet}.${PDY}/gempak grid2="F-UKMETHPC | ${PDY2}/0000" # for gfsfhr in 00 12 24 36 48 60 84 108 for gfsfhr in 00 12 24 84 108 @@ -534,7 +534,7 @@ export err=$?;err_chk done # COMPARE THE 0000 UTC GFS MODEL TO THE 1200 UTC UKMET FROM YESTERDAY grid="F-${MDL} | ${PDY2}/${cyc}00" - export HPCUKMET=${COMINukmet}.${PDYm1} + export HPCUKMET=${COMINukmet}.${PDYm1}/gempak grid2="F-UKMETHPC | ${PDY2m1}/1200" # for gfsfhr in 00 12 24 36 48 60 84 108 for gfsfhr in 00 12 24 84 108 diff --git a/gempak/ush/gfs_meta_sa2.sh b/gempak/ush/gfs_meta_sa2.sh index de538a249d..a566031030 100755 --- a/gempak/ush/gfs_meta_sa2.sh +++ b/gempak/ush/gfs_meta_sa2.sh @@ -303,7 +303,7 @@ do ukmetfhr=${gfsfhr} fi gfsfhr="F${gfsfhr}" - grid3="${COMINukmet}.${PDY}/ukmet_${PDY}00f${ukmetfhr}" + grid3="${COMINukmet}.${PDY}/gempak/ukmet_${PDY}00f${ukmetfhr}" $GEMEXE/gdplot2_nc << EOF25 \$MAPFIL = mepowo.gsf