Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New BNU soil type and VIIRS vegetation type data #843

Merged

Conversation

GeorgeGayno-NOAA
Copy link
Collaborator

@GeorgeGayno-NOAA GeorgeGayno-NOAA commented Aug 18, 2023

DESCRIPTION OF CHANGES:

A new version of the VIIRS vegetation type data was created that removes spurious snow points in warm regions.
And a new version of the BNU soil type data was created that is compatible with the updated vegetation data.
It also includes additional records for the percentage and sand and clay.

Only high-res versions of these data (global 30 second) will be baselined. Previous versions of these data included several lower-res versions that reduced the computational resources required to create model grids. Due to a quirk in the ESMF library, increasing the number of MPI tasks for high-res input data can cause a failure when processing low-res data, such as the soil substrate temperature data. Therefore, a resampled (0.5-degree) version of the 2.6x1.5 degree soil substrate data will be baselined as well.

Update UFS_UTILS to use this new data.

TESTS CONDUCTED:

These tests were done using 76a3b02

  • Compile branch on all Tier 1 machines using Intel (Orion, Jet, Hera and WCOSS2).
  • Compile branch on Hera using GNU.
  • Compile branch in 'Debug' mode on WCOSS2.
  • Run unit tests locally on any Tier 1 machine. Done on Hera.
  • Run relevant consistency tests locally on all Tier 1 machine.

All grid_gen consistency tests failed as expected. One source of the failure was the use of the new soil substrate temperature. That data was resampled to higher resolution. Also, the current low-res data has incorrect geo-referencing. Some comparisons using the new and current substrate data are documented in #821.

The "c96.viirs.bnu" test showed differences beyond the substrate temperature field. That is because it used the new 'v3' soil and vegetation type data. These differences were visually compared against the baseline files and found to be reasonable and expected.

All baseline test data will be updated on all machines after the merge.

DEPENDENCIES:

The new soil, veg and soil substrate files must be added to the official 'fix' directories on all machines.

  • soil_type.bnu.v3.30s.nc
  • vegetation_type.viirs.v3.igbp.30s.nc
  • substrate_temperature.gfs.0.5.nc

The following snow-contaminated files should be removed:

  • soil_type.bnu.30s.nc
  • vegetation_type.viirs.igbp.0.03.nc
  • vegetation_type.viirs.igbp.0.1.nc
  • vegetation_type.viirs.igbp.conus.30s.nc
  • vegetation_type.viirs.igbp.0.05.nc
  • vegetation_type.viirs.igbp.30s.nc
  • vegetation_type.viirs.igbp.nh.30s.nc

DOCUMENTATION:

Update 'readthedocs' for new input data:
https://georgegayno-noaaufs-utils.readthedocs.io/en/bugfix-bnu_soil/ufs_utils.html#id58

ISSUE:

Fixes #821.
Related to #803.

CONTRIBUTORS:

@barlage

Copy link
Collaborator

@barlage barlage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@GeorgeGayno-NOAA GeorgeGayno-NOAA marked this pull request as ready for review August 21, 2023 19:24
@GeorgeGayno-NOAA
Copy link
Collaborator Author

The list of files that need to be added/removed from the 'fixed' directories is here: #821 (comment)

@GeorgeGayno-NOAA
Copy link
Collaborator Author

@WalterKolczynski-NOAA or @KateFriedman-NOAA - this PR requires three new files in the ./fix/sfc_climo directory. These files are:

  • /scratch2/NCEPDEV/land/data/input_data/vegetation_type/vegetation_type.viirs.v3.igbp.30s.nc
  • /scratch2/NCEPDEV/land/data/input_data/soil_type/soil_type.bnu.v3.30s.nc
  • /scratch1/NCEPDEV/da/George.Gayno/ufs_utils.git/UFS_UTILS/fix/sfc_climo.test/substrate_temperature.gfs.0.5.nc

The new 'veg' and 'soil' files replace earlier versions with bad 'glacial' points. Can these be removed or moved to a deprecated directory? These bad files are:

  • soil_type.bnu.30s.nc
  • vegetation_type.viirs.igbp.0.03.nc
  • vegetation_type.viirs.igbp.0.1.nc
  • vegetation_type.viirs.igbp.conus.30s.nc
  • vegetation_type.viirs.igbp.0.05.nc
  • vegetation_type.viirs.igbp.30s.nc
  • vegetation_type.viirs.igbp.nh.30s.nc

@KateFriedman-NOAA
Copy link
Collaborator

@WalterKolczynski-NOAA or @KateFriedman-NOAA - this PR requires three new files in the ./fix/sfc_climo directory.

@GeorgeGayno-NOAA can you open a global-workflow "Fix File Update" issue with these details? We'll make the update. Thanks!

that contains the new soil and veg files.

Fixes ufs-community#821.
@GeorgeGayno-NOAA GeorgeGayno-NOAA merged commit 2ed2c79 into ufs-community:develop Sep 26, 2023
4 checks passed
@GeorgeGayno-NOAA GeorgeGayno-NOAA deleted the bugfix/bnu_soil branch September 27, 2023 13:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test new BNU soil type and VIIRS vegetation type data
3 participants