Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pickup changes from GFSv16.3, and update 1D-decomposed GTG compatible with UPP #645

Merged
merged 6 commits into from
Mar 15, 2023

Conversation

YaliMao-NOAA
Copy link
Contributor

@YaliMao-NOAA YaliMao-NOAA commented Feb 28, 2023

  1. Reshape array inputs of gtg_algo in MDLFLD.f. GTG has its own exch()
  2. Change hard code numx=2 overwritable. Set numx=1 in job card when running GTG
  3. As a reminder, set mem=300GB in job card when running GTG

@WenMeng-NOAA
Copy link
Collaborator

@YaliMao-NOAA Please sync your branch with the top of the UPP develop.

@WenMeng-NOAA
Copy link
Collaborator

@YaliMao-NOAA It seems to me a lot of changes in this PR are synced from WAFS related updates from GFS V16.3 implementation?

@YaliMao-NOAA
Copy link
Contributor Author

@YaliMao-NOAA It seems to me a lot of changes in this PR are synced from WAFS related updates from GFS V16.3 implementation?

Yes, the changes include three GFSv16.3 PRs:
#497
#542
#543

@WenMeng-NOAA
Copy link
Collaborator

@YaliMao-NOAA It seems to me a lot of changes in this PR are synced from WAFS related updates from GFS V16.3 implementation?

Yes, the changes include three GFSv16.3 PRs: #497 #542 #543

@YaliMao-NOAA Can you open a new UPP issue for syncing changes of WAFS from GFS V16.3 implementation?

@YaliMao-NOAA YaliMao-NOAA changed the title Make 1D decomposition of GTG compatible with UPP Pickup changes from GFSv16.3, and update 1D-decomposed GTG compatible with UPP Mar 8, 2023
@WenMeng-NOAA
Copy link
Collaborator

@YaliMao-NOAA Can you sync your branch one more time? Thanks!

@YaliMao-NOAA
Copy link
Contributor Author

@WenMeng-NOAA
I did the synchronization. I did a test run, and it turned out the master file is bit-wise consistent with the older version. Is it supposed the recent updates won't change the master file?
Thank you.

@@ -505,7 +447,7 @@ SUBROUTINE MDL2STD_P()

! Relabel the pressure level to reference levels
! IDS = 0
IDS = (/ 450,480,464,465,466,518,519,520,521,522,523,524,525,(0,I=14,50) /)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@YaliMao-NOAA It appears to me output ID 522 is still kept in this routine. Do you intend to remove it?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a good point. I am going to consult UK and AWC whether to keep it for GFSv17, incluidng U/V/T too.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@YaliMao-NOAA You might keep ID 522 in this PR and change later if it is needed. In that case, can you change "521,(0,I=10,50)" into "521,522,(0,I=11,50)"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@WenMeng-NOAA I removed 522 (for RH_ON_ICAO_STD_SFC) from UPP, and the code was modified accordingly.

(IGET(774)>0).OR.(IGET(747)>0).OR. &
(IGET(464)>0).OR.(IGET(467)>0).OR. &
(IGET(470)>0).OR.(IGET(476)>0).OR. &
(IGET(629)>0).OR.(IGET(630)>0).OR. &
(IGET(470)>0).OR. &
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@YaliMao-NOAA You may remove this line since "IGET(470)>0" is available in line 934.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! Good catch.

@WenMeng-NOAA
Copy link
Collaborator

@YaliMao-NOAA Please verify wafs data file gfs.t00z.wafs.grb2f006 at my test /u/wen.meng/ptmp/gfs.2019083000 on Cactus and let me know if there are any discrepancies with your test.

@WenMeng-NOAA WenMeng-NOAA added the Ready for Review This PR is ready for code review. label Mar 14, 2023
@YaliMao-NOAA
Copy link
Contributor Author

YaliMao-NOAA commented Mar 14, 2023

@YaliMao-NOAA Please verify wafs data file gfs.t00z.wafs.grb2f006 at my test /u/wen.meng/ptmp/gfs.2019083000 on Cactus and let me know if there are any discrepancies with your test.

I compared your wafs output and mine at /lfs/h2/emc/ptmp/yali.mao/upp/com/gfs.20190830/00. They are not bit-wise consistent but with good value of rpn_corr and rpn_rms.

Update: sorry I forgot to mention that the master files are bit-wise consistent.

@FernandoAndrade-NOAA
Copy link
Collaborator

Hello, UPP RT tests have completed on Hera and Orion with no changes to results.

@WenMeng-NOAA
Copy link
Collaborator

To generate gtg product, should I still overwrite UPP/parm/gtg.cong.gfs with UPP/sorc/ncep_post.fd/post_gtg.fd/gtg.config.gfs? @YaliMao-NOAA

@YaliMao-NOAA
Copy link
Contributor Author

To generate gtg product, should I still overwrite UPP/parm/gtg.cong.gfs with UPP/sorc/ncep_post.fd/post_gtg.fd/gtg.config.gfs? @YaliMao-NOAA

Good point. Yes, sorc/ncep_post.fd/post_gtg.fd/gtg.config.gfs is the right one to generate GTG

@WenMeng-NOAA
Copy link
Collaborator

To generate gtg product, should I still overwrite UPP/parm/gtg.cong.gfs with UPP/sorc/ncep_post.fd/post_gtg.fd/gtg.config.gfs? @YaliMao-NOAA

Good point. Yes, sorc/ncep_post.fd/post_gtg.fd/gtg.config.gfs is the right one to generate GTG

Can you pick up my driver script submit_run_post_gfs_gtg_wcoss2.sh at /u/wen.meng/noscrub/ncep_post/yali/UPP on Cactus to check any difference from yours? @YaliMao-NOAA

@YaliMao-NOAA
Copy link
Contributor Author

I had another test run with a different number of CPUs, my two results are bit-wise consistent.
Yours and mine have most fields with good value of rpn_corr>=0.999 and some fields are bit-wise consistent.

@WenMeng-NOAA
Copy link
Collaborator

WenMeng-NOAA commented Mar 15, 2023

I had another test run with a different number of CPUs, my two results are bit-wise consistent. Yours and mine have most fields with good value of rpn_corr>=0.999 and some fields are bit-wise consistent.

Can you point me to your run directory? I don't see any reasons which made wafs files not bitwise identical between your test and my test. @YaliMao-NOAA

@YaliMao-NOAA
Copy link
Contributor Author

YaliMao-NOAA commented Mar 15, 2023

I had another test run with a different number of CPUs, my two results are bit-wise consistent. Yours and mine have most fields with good value of rpn_corr>=0.999 and some fields are bit-wise consistent.

Can you point me to your run directory? I don't see any reasons which made wafs files not bitwise identical between your test and my test. @YaliMao-NOAA

Source code: /lfs/h2/emc/vpppg/noscrub/yali.mao/git/UPP.v17 on Cactus
Run result: /lfs/h2/emc/ptmp/yali.mao/upp/com/gfs.20190830/00

@WenMeng-NOAA
Copy link
Collaborator

My new gtg test can duplicate Yali's test with some changes in test configuration.

@WenMeng-NOAA
Copy link
Collaborator

The UPP RT tests were completed on WCOSS2 with no changed results. This PR is ready for merging.

@WenMeng-NOAA WenMeng-NOAA added the No Baseline Change No baseline of the UPP regression tests are made. label Mar 15, 2023
@WenMeng-NOAA
Copy link
Collaborator

No baseline update is needed with this PR.

@WenMeng-NOAA WenMeng-NOAA merged commit a74d1c1 into NOAA-EMC:develop Mar 15, 2023
@YaliMao-NOAA YaliMao-NOAA deleted the v17 branch May 31, 2023 15:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
GEFSV13 GFSV17 No Baseline Change No baseline of the UPP regression tests are made. Ready for Review This PR is ready for code review.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Sync wafs related changes from GFS V16.3 Implementation Make 1D decomposition of GTG compatible with UPP
3 participants