Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement the capability to process chemical model NETCDF output and UFS-Aerosols model output #561

Merged
merged 10 commits into from
Oct 17, 2022

Conversation

zhanglikate
Copy link
Contributor

@zhanglikate zhanglikate commented Sep 9, 2022

The previous UPP can only process the NEMSIO format for chemical output of GEFS-Aerosols. The updates has implemented the capability to read the chemical model NETCDF output for both GEFS-Aerosols (by turning on gocart_on) and UFS-Aerosols (by turning on nasa_on).
Also, re-assign the 6 AOD from GFS from 600-605 (rdaod) and Update the look-up table for UFS-Aerosols (nasa_on).

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate Can you provide me model history files for testing new aerosol products? Thanks!

@zhanglikate
Copy link
Contributor Author

@zhanglikate Can you provide me model history files for testing new aerosol products? Thanks!

@WenMeng-NOAA You can find the netcdf output with chemical fields at: /scratch2/NCEPDEV/naqfc/Kate.Zhang/fv3gfs/comrot/NP8C_C96_ATM/gfs.20160715-nofb/00/atmos

Thanks.

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate My test is at /scratch1/NCEPDEV/stmp2/Wen.Meng/post_gfs_2016071500. Can you verify if it is consistent with your test?

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate My test is at /scratch1/NCEPDEV/stmp2/Wen.Meng/post_gfs_2016071500. Can you verify if it is consistent with your test?

@zhanglikate
Copy link
Contributor Author

@zhanglikate My test is at /scratch1/NCEPDEV/stmp2/Wen.Meng/post_gfs_2016071500. Can you verify if it is consistent with your test?

I am wondering how can I compare it? This is my test: /scratch1/NCEPDEV/stmp2/Kate.Zhang/post_gfs_2016071500

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate My test is at /scratch1/NCEPDEV/stmp2/Wen.Meng/post_gfs_2016071500. Can you verify if it is consistent with your test?

I am wondering how can I compare it? This is my test: /scratch1/NCEPDEV/stmp2/Kate.Zhang/post_gfs_2016071500

@zhanglikate It looks the master file from UPP were not archived in your test. Can you take a look at the mast file from my test GFSPRS.GrbF12 if all expected variables (postcntrl_ufs_aerosol.xml) are there?

@zhanglikate
Copy link
Contributor Author

@WenMeng-NOAA How can I check the file of GFSPRS.GrbF12 ? Which tool that I can use to check it? Thanks. Or any way that I can archived the master file in my test?

@WenMeng-NOAA
Copy link
Collaborator

@WenMeng-NOAA How can I check the file of GFSPRS.GrbF12 ? Which tool that I can use to check it? Thanks. Or any way that I can archived the master file in my test?

@zhanglikate The GFSPRS.GrbF12 is grib2 file generated in UPP with your UPP control file postcntrl_ufs_aerosol.xml. You might use wgrib2 to dump it.

@zhanglikate
Copy link
Contributor Author

@WenMeng-NOAA How can I check the file of GFSPRS.GrbF12 ? Which tool that I can use to check it? Thanks. Or any way that I can archived the master file in my test?

@zhanglikate The GFSPRS.GrbF12 is grib2 file generated in UPP with your UPP control file postcntrl_ufs_aerosol.xml. You might use wgrib2 to dump it.

@WenMeng-NOAA What is the resolution? 0.25, 0.5 or 1?

@zhanglikate
Copy link
Contributor Author

zhanglikate commented Sep 19, 2022

@WenMeng-NOAA How can I check the file of GFSPRS.GrbF12 ? Which tool that I can use to check it? Thanks. Or any way that I can archived the master file in my test?

@zhanglikate The GFSPRS.GrbF12 is grib2 file generated in UPP with your UPP control file postcntrl_ufs_aerosol.xml. You might use wgrib2 to dump it.

@WenMeng-NOAA I have the master output at: /scratch1/NCEPDEV/stmp2/Kate.Zhang/gfs.2016071500 , I just converted them to Netcdf and compared with your results, for the chemical related fields, they are identical. Thanks.

…gfs_atmos_nceppost.sh)

Clean the unused dust variables in FDLVL.f and MDL2P.f
@lipan-NOAA
Copy link
Contributor

@zhanglikate is there any reason for this revert (3f43201) ?

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate is there any reason for this revert (3f43201) ?

@lipan-NOAA I suggested @zhanglikate to revert the changes because these two scripts are used for GFS post processing only. The changes could be added when the benchmarks for GFS V17 or GEFS V13 implementations are started.

@@ -5490,6 +5377,43 @@ SUBROUTINE CLDRAD
datapd(1:iend-ista+1,1:jend-jsta+1,cfld)=GRID1(ista:iend,jsta:jend)
endif
ENDIF
#if 0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate May I ask for the intention of the line "#if 0" and "endif"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It means that the parts between "#if 0" and "#endif" are commented out.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate I saw the warning message from compiling as:

/home/Wen.Meng/stmp2/kate/UPP/sorc/ncep_post.fd/CLDRAD.f(5380): warning #5117: Bad # preprocessor line
#if 0
-^
/home/Wen.Meng/stmp2/kate/UPP/sorc/ncep_post.fd/CLDRAD.f(5415): warning #5117: Bad # preprocessor line
#endif

The block is new code for outputting two new variables. You commented it out temporarily?

@zhanglikate
Copy link
Contributor Author

Yes. I think we have to cancel the part by commenting out now. Thanks.

@WenMeng-NOAA
Copy link
Collaborator

@zhanglikate Can you add change logs with your name at the beginning section of all fortran files you modified?

@@ -812,6 +789,7 @@ SUBROUTINE FDLVL_UV(ITYPE,NFD,HTFD,UFD,VFD)
!> 2017-06-01 | Y Mao | Add FD levels for GTG(EDPARM CATEDR MWTURB) and allow levels input from control file
!> 2019-09-25 | Y Mao | Seperate mass from UV allow array of mass input to interpolate multiple fields with the same levels at one time. Dust=> AERFD can be processed when NIN=NBIN_DU
!> 2020-11-10 | Jesse Meng | Use UPP_PHYSICS module
!> 2022-09-22 | Li(Kate) Zhang | Remove Dust=> AERFD
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate Should this change log be moved to after line 4?

Copy link
Contributor Author

@zhanglikate zhanglikate Oct 5, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@WenMeng-NOAA Which line 4?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate Sorry for typo. Line 41.

IF(DUST(I,J,1,K) < SPVAL) DUSTSL(I,J,K) = DUST(I,J,1,K)
ENDDO
endif
! if (gocart_on) then
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate Since these are legacy code, could they be deleted instead of commented out?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@WenMeng-NOAA Removed. Thanks.

@@ -2062,130 +2061,7 @@ SUBROUTINE MDL2P(iostatusD3D)
endif
ENDIF
ENDIF
if (gocart_on) then
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhanglikate Since the output of UPP ID 439 to 442 in this routine, could you update post_avblflds.xml for removing their definitions?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@WenMeng-NOAA Removed. Thanks.

Copy link
Contributor

@lipan-NOAA lipan-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked through changes and tested it on Hera. It looks fine for me

2. Re-assign the 6 AOD from GFS from 600-605 (rdaod).
3. Update the look-up table for UFS-Aerosols (nasa_on).
@lipan-NOAA
Copy link
Contributor

@zhanglikate did you update the NASA lookup tables using Sarah's code ?

@zhanglikate
Copy link
Contributor Author

zhanglikate commented Oct 12, 2022

@lipan-NOAA Yes. I am using the code you sent to me to update it, which I think it is from Sarah.

@WenMeng-NOAA WenMeng-NOAA added GFSV17 No Baseline Change No baseline of the UPP regression tests are made. Ready for Review This PR is ready for code review. labels Oct 14, 2022
@WenMeng-NOAA
Copy link
Collaborator

The UPP RT tests were completed on WCOSS2, Hera and Orion. No baseline updates are needed with this PR.

@WenMeng-NOAA
Copy link
Collaborator

@lipan-NOAA, @JianpingHuang-NOAA and @AnningCheng-NOAA Please let me know if any unexpected results are found from your testing for GEFS aerosol, AQM, and GFSV17 MERRA aerosol. Thanks!

@lipan-NOAA
Copy link
Contributor

@WenMeng-NOAA Could you point me the directory of your test on WCOSS2 ?

@WenMeng-NOAA
Copy link
Collaborator

@WenMeng-NOAA Could you point me the directory of your test on WCOSS2 ?

@lipan-NOAA Please see on cactus:

  • the test with current develop branch: /u/wen.meng/ptmp/post_fv3chem_2022042400-before
  • the test with Kate's branch: /u/wen.meng/ptmp/post_fv3chem_2022042400-after

The two tests use the same model history files provided from you. Thanks!

@AnningCheng-NOAA
Copy link
Contributor

The modifications related to MERRA2 (rdaod=T) looks fine and passed my tests. Approved.

@WenMeng-NOAA WenMeng-NOAA merged commit fb3dc8d into NOAA-EMC:develop Oct 17, 2022
EricJames-NOAA pushed a commit to EricJames-NOAA/UPP that referenced this pull request Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
GFSV17 No Baseline Change No baseline of the UPP regression tests are made. Ready for Review This PR is ready for code review.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement the capability to process chemical model NETCDF output and UFS-Aerosols model output
4 participants