Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UFS-dev PR#56 #96

Merged
merged 12 commits into from
May 8, 2023
Merged

UFS-dev PR#56 #96

merged 12 commits into from
May 8, 2023

Conversation

grantfirl
Copy link
Collaborator

@grantfirl grantfirl commented Apr 25, 2023

Identical to #ufs-community#1669 (no baseline changes due to this alone)

Also contains changes from the following:

ufs-community#1407 (changes baselines):
FAILED TESTS:
Test hafs_regional_atm_wav 125 failed in check_result failed
Test hafs_regional_atm_wav 125 failed in run_test failed
Test hafs_regional_atm_ocn_wav 126 failed in check_result failed
Test hafs_regional_atm_ocn_wav 126 failed in run_test failed
Test hafs_regional_storm_following_1nest_atm_ocn_wav 136 failed in check_result failed
Test hafs_regional_storm_following_1nest_atm_ocn_wav 136 failed in run_test failed
Test atmwav_control_noaero_p8 158 failed in check_result failed
Test atmwav_control_noaero_p8 158 failed in run_test failed

ufs-community#1704 (no changes to baselines)

ufs-community#1690 (changes baselines)
hera/intel
Test cpld_bmark_p8 013 failed in check_result failed
Test cpld_bmark_p8 013 failed in run_test failed
Test control_latlon 026 failed in check_result failed
Test control_latlon 026 failed in run_test failed
Test control_wrtGauss_netcdf_parallel 027 failed in check_result failed
Test control_wrtGauss_netcdf_parallel 027 failed in run_test failed
Test control_c192 029 failed in check_result failed
Test control_c192 029 failed in run_test failed
Test control_c384 030 failed in check_result failed
Test control_c384 030 failed in run_test failed
Test control_c384gdas 031 failed in check_result failed
Test control_c384gdas 031 failed in run_test failed
Test control_stochy 032 failed in check_result failed
Test control_stochy 032 failed in run_test failed
Test control_lndp 034 failed in check_result failed
Test control_lndp 034 failed in run_test failed
Test control_iovr4 035 failed in check_result failed
Test control_iovr4 035 failed in run_test failed
Test control_iovr5 036 failed in check_result failed
Test control_iovr5 036 failed in run_test failed
Test control_p8 037 failed in check_result failed
Test control_p8 037 failed in run_test failed
Test control_qr_p8 039 failed in check_result failed
Test control_qr_p8 039 failed in run_test failed
Test control_decomp_p8 041 failed in check_result failed
Test control_decomp_p8 041 failed in run_test failed
Test control_2threads_p8 042 failed in check_result failed
Test control_2threads_p8 042 failed in run_test failed
Test control_p8_lndp 043 failed in check_result failed
Test control_p8_lndp 043 failed in run_test failed
Test control_p8_rrtmgp 044 failed in check_result failed
Test control_p8_rrtmgp 044 failed in run_test failed
Test control_p8_mynn 045 failed in check_result failed
Test control_p8_mynn 045 failed in run_test failed
Test merra2_thompson 046 failed in check_result failed
Test merra2_thompson 046 failed in run_test failed
Test rap_control 057 failed in check_result failed
Test rap_control 057 failed in run_test failed
Test regional_spp_sppt_shum_skeb 058 failed in check_result failed
Test regional_spp_sppt_shum_skeb 058 failed in run_test failed
Test rap_decomp 059 failed in check_result failed
Test rap_decomp 059 failed in run_test failed
Test rap_2threads 060 failed in check_result failed
Test rap_2threads 060 failed in run_test failed
Test rap_sfcdiff 062 failed in check_result failed
Test rap_sfcdiff 062 failed in run_test failed
Test rap_sfcdiff_decomp 063 failed in check_result failed
Test rap_sfcdiff_decomp 063 failed in run_test failed
Test hrrr_control 065 failed in check_result failed
Test hrrr_control 065 failed in run_test failed
Test hrrr_control_decomp 066 failed in check_result failed
Test hrrr_control_decomp 066 failed in run_test failed
Test hrrr_control_2threads 067 failed in check_result failed
Test hrrr_control_2threads 067 failed in run_test failed
Test rrfs_v1beta 069 failed in check_result failed
Test rrfs_v1beta 069 failed in run_test failed
Test rrfs_v1nssl 070 failed in check_result failed
Test rrfs_v1nssl 070 failed in run_test failed
Test rrfs_v1nssl_nohailnoccn 071 failed in check_result failed
Test rrfs_v1nssl_nohailnoccn 071 failed in run_test failed
Test control_csawmg 077 failed in check_result failed
Test control_csawmg 077 failed in run_test failed
Test control_csawmgt 078 failed in check_result failed
Test control_csawmgt 078 failed in run_test failed
Test control_ras 079 failed in check_result failed
Test control_ras 079 failed in run_test failed
Test control_p8_faster 081 failed in check_result failed
Test control_p8_faster 081 failed in run_test failed
Test regional_spp_sppt_shum_skeb_dyn32_phy32 110 failed in check_result failed
Test regional_spp_sppt_shum_skeb_dyn32_phy32 110 failed in run_test failed
Test rap_control_dyn32_phy32 111 failed in check_result failed
Test rap_control_dyn32_phy32 111 failed in run_test failed
Test hrrr_control_dyn32_phy32 112 failed in check_result failed
Test hrrr_control_dyn32_phy32 112 failed in run_test failed
Test rap_2threads_dyn32_phy32 113 failed in check_result failed
Test rap_2threads_dyn32_phy32 113 failed in run_test failed
Test hrrr_control_2threads_dyn32_phy32 114 failed in check_result failed
Test hrrr_control_2threads_dyn32_phy32 114 failed in run_test failed
Test hrrr_control_decomp_dyn32_phy32 115 failed in check_result failed
Test hrrr_control_decomp_dyn32_phy32 115 failed in run_test failed
Test rap_control_dyn64_phy32 118 failed in check_result failed
Test rap_control_dyn64_phy32 118 failed in run_test failed
Test control_atmwav 159 failed in check_result failed
Test control_atmwav 159 failed in run_test failed
Test atmaero_control_p8 160 failed in check_result failed
Test atmaero_control_p8 160 failed in run_test failed
Test atmaero_control_p8_rad 161 failed in check_result failed
Test atmaero_control_p8_rad 161 failed in run_test failed
Test atmaero_control_p8_rad_micro 162 failed in check_result failed
Test atmaero_control_p8_rad_micro 162 failed in run_test failed

hera/gnu
Test control_stochy 002 failed in check_result failed
Test control_stochy 002 failed in run_test failed
Test control_ras 003 failed in check_result failed
Test control_ras 003 failed in run_test failed
Test control_p8 004 failed in check_result failed
Test control_p8 004 failed in run_test failed
Test rap_control 005 failed in check_result failed
Test rap_control 005 failed in run_test failed
Test rap_decomp 006 failed in check_result failed
Test rap_decomp 006 failed in run_test failed
Test rap_2threads 007 failed in check_result failed
Test rap_2threads 007 failed in run_test failed
Test rap_sfcdiff 009 failed in check_result failed
Test rap_sfcdiff 009 failed in run_test failed
Test rap_sfcdiff_decomp 010 failed in check_result failed
Test rap_sfcdiff_decomp 010 failed in run_test failed
Test hrrr_control 012 failed in check_result failed
Test hrrr_control 012 failed in run_test failed
Test hrrr_control_2threads 013 failed in check_result failed
Test hrrr_control_2threads 013 failed in run_test failed
Test hrrr_control_decomp 014 failed in check_result failed
Test hrrr_control_decomp 014 failed in run_test failed
Test rrfs_v1beta 016 failed in check_result failed
Test rrfs_v1beta 016 failed in run_test failed
Test rap_control_dyn32_phy32 037 failed in check_result failed
Test rap_control_dyn32_phy32 037 failed in run_test failed
Test hrrr_control_dyn32_phy32 038 failed in check_result failed
Test hrrr_control_dyn32_phy32 038 failed in run_test failed
Test rap_2threads_dyn32_phy32 039 failed in check_result failed
Test rap_2threads_dyn32_phy32 039 failed in run_test failed
Test hrrr_control_2threads_dyn32_phy32 040 failed in check_result failed
Test hrrr_control_2threads_dyn32_phy32 040 failed in run_test failed
Test hrrr_control_decomp_dyn32_phy32 041 failed in check_result failed
Test hrrr_control_decomp_dyn32_phy32 041 failed in run_test failed
Test rap_control_dyn64_phy32 044 failed in check_result failed
Test rap_control_dyn64_phy32 044 failed in run_test failed

DeniseWorthen and others added 6 commits April 11, 2023 08:35
* orginal version is atmwm (m=multi); atmw = cmeps/mesh cap

* input_nml for control_p8 and atmwave p8 test are different only
in cplwav and cplwav2atm logicals
* fix the fdiag for GEFS EP4

* update fv3 with atm.logf file
* Rename global fv3 inline post itag and control files.

* Set read merra2 as default; add SDEN in gfs control file.

* Update cpld_control_run.IN for changing post_itag name.
… develop (ufs-community#1669)

* Updates to new unified convection, cleaning etc

---------

Co-authored-by: Jessica Meixner <Jessica.Meixner@noaa.gov>
@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: cheyenne
Compiler: gnu
Job: RT
[RT] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230501140024/ufs-weather-model
Please make changes and add the following label back: cheyenne-gnu-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: gnu
Job: RT
[RT] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230501200017/ufs-weather-model
Please make changes and add the following label back: hera-gnu-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: intel
Job: RT
[RT] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230501200854/ufs-weather-model
Please make changes and add the following label back: hera-intel-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: cheyenne
Compiler: intel
Job: RT
[RT] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230501140746/ufs-weather-model
Please make changes and add the following label back: cheyenne-intel-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: cheyenne
Compiler: gnu
Job: RT
[RT] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230503114511/ufs-weather-model
[RT] Error: Test control_stochy 002 failed in check_result failed
[RT] Error: Test control_stochy 002 failed in run_test failed
[RT] Error: Test control_ras 003 failed in check_result failed
[RT] Error: Test control_ras 003 failed in run_test failed
[RT] Error: Test control_p8 004 failed in check_result failed
[RT] Error: Test control_p8 004 failed in run_test failed
[RT] Error: Test rap_control 005 failed in check_result failed
[RT] Error: Test rap_control 005 failed in run_test failed
[RT] Error: Test rap_decomp 006 failed in check_result failed
[RT] Error: Test rap_decomp 006 failed in run_test failed
[RT] Error: Test rap_2threads 007 failed in check_result failed
[RT] Error: Test rap_2threads 007 failed in run_test failed
[RT] Error: Test rap_sfcdiff 009 failed in check_result failed
[RT] Error: Test rap_sfcdiff 009 failed in run_test failed
[RT] Error: Test rap_sfcdiff_decomp 010 failed in check_result failed
[RT] Error: Test rap_sfcdiff_decomp 010 failed in run_test failed
[RT] Error: Test hrrr_control 012 failed in check_result failed
[RT] Error: Test hrrr_control 012 failed in run_test failed
[RT] Error: Test hrrr_control_2threads 013 failed in check_result failed
[RT] Error: Test hrrr_control_2threads 013 failed in run_test failed
[RT] Error: Test hrrr_control_decomp 014 failed in check_result failed
[RT] Error: Test hrrr_control_decomp 014 failed in run_test failed
[RT] Error: Test rrfs_v1beta 016 failed in check_result failed
[RT] Error: Test rrfs_v1beta 016 failed in run_test failed
[RT] Error: Test rap_control_dyn32_phy32 037 failed in check_result failed
[RT] Error: Test rap_control_dyn32_phy32 037 failed in run_test failed
[RT] Error: Test hrrr_control_dyn32_phy32 038 failed in check_result failed
[RT] Error: Test hrrr_control_dyn32_phy32 038 failed in run_test failed
[RT] Error: Test rap_2threads_dyn32_phy32 039 failed in check_result failed
[RT] Error: Test rap_2threads_dyn32_phy32 039 failed in run_test failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 040 failed in check_result failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 040 failed in run_test failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 041 failed in check_result failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 041 failed in run_test failed
[RT] Error: Test rap_control_dyn64_phy32 044 failed in check_result failed
[RT] Error: Test rap_control_dyn64_phy32 044 failed in run_test failed
Please make changes and add the following label back: cheyenne-gnu-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: cheyenne
Compiler: intel
Job: RT
[RT] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230503123612/ufs-weather-model
[RT] Error: Test cpld_control_p8_mixedmode 001 failed in check_result failed
[RT] Error: Test cpld_control_p8_mixedmode 001 failed in run_test failed
[RT] Error: Test cpld_control_gfsv17 002 failed in check_result failed
[RT] Error: Test cpld_control_gfsv17 002 failed in run_test failed
[RT] Error: Test cpld_control_p8 003 failed in check_result failed
[RT] Error: Test cpld_control_p8 003 failed in run_test failed
[RT] Error: Test cpld_control_qr_p8 005 failed in check_result failed
[RT] Error: Test cpld_control_qr_p8 005 failed in run_test failed
[RT] Error: Test cpld_2threads_p8 007 failed in check_result failed
[RT] Error: Test cpld_2threads_p8 007 failed in run_test failed
[RT] Error: Test cpld_decomp_p8 008 failed in check_result failed
[RT] Error: Test cpld_decomp_p8 008 failed in run_test failed
[RT] Error: Test cpld_mpi_p8 009 failed in check_result failed
[RT] Error: Test cpld_mpi_p8 009 failed in run_test failed
[RT] Error: Test cpld_control_ciceC_p8 010 failed in check_result failed
[RT] Error: Test cpld_control_ciceC_p8 010 failed in run_test failed
[RT] Error: Test cpld_control_c192_p8 011 failed in check_result failed
[RT] Error: Test cpld_control_c192_p8 011 failed in run_test failed
[RT] Error: Test cpld_control_noaero_p8 013 failed in check_result failed
[RT] Error: Test cpld_control_noaero_p8 013 failed in run_test failed
[RT] Error: Test cpld_control_nowave_noaero_p8 014 failed in check_result failed
[RT] Error: Test cpld_control_nowave_noaero_p8 014 failed in run_test failed
[RT] Error: Test cpld_debug_p8 015 failed in check_result failed
[RT] Error: Test cpld_debug_p8 015 failed in run_test failed
[RT] Error: Test cpld_debug_noaero_p8 016 failed in check_result failed
[RT] Error: Test cpld_debug_noaero_p8 016 failed in run_test failed
[RT] Error: Test cpld_control_noaero_p8_agrid 017 failed in check_result failed
[RT] Error: Test cpld_control_noaero_p8_agrid 017 failed in run_test failed
[RT] Error: Test cpld_control_c48 018 failed in check_result failed
[RT] Error: Test cpld_control_c48 018 failed in run_test failed
[RT] Error: Test cpld_warmstart_c48 019 failed in check_result failed
[RT] Error: Test cpld_warmstart_c48 019 failed in run_test failed
[RT] Error: Test control_CubedSphereGrid 021 failed in check_result failed
[RT] Error: Test control_CubedSphereGrid 021 failed in run_test failed
[RT] Error: Test control_CubedSphereGrid_parallel 022 failed in check_result failed
[RT] Error: Test control_CubedSphereGrid_parallel 022 failed in run_test failed
[RT] Error: Test control_latlon 023 failed in check_result failed
[RT] Error: Test control_latlon 023 failed in run_test failed
[RT] Error: Test control_wrtGauss_netcdf_parallel 024 failed in check_result failed
[RT] Error: Test control_wrtGauss_netcdf_parallel 024 failed in run_test failed
[RT] Error: Test control_c48 025 failed in check_result failed
[RT] Error: Test control_c48 025 failed in run_test failed
[RT] Error: Test control_c192 026 failed in check_result failed
[RT] Error: Test control_c192 026 failed in run_test failed
[RT] Error: Test control_c384 027 failed in check_result failed
[RT] Error: Test control_c384 027 failed in run_test failed
[RT] Error: Test control_c384gdas 028 failed in check_result failed
[RT] Error: Test control_c384gdas 028 failed in run_test failed
[RT] Error: Test control_stochy 029 failed in check_result failed
[RT] Error: Test control_stochy 029 failed in run_test failed
[RT] Error: Test control_lndp 031 failed in check_result failed
[RT] Error: Test control_lndp 031 failed in run_test failed
[RT] Error: Test control_iovr4 032 failed in check_result failed
[RT] Error: Test control_iovr4 032 failed in run_test failed
[RT] Error: Test control_iovr5 033 failed in check_result failed
[RT] Error: Test control_iovr5 033 failed in run_test failed
[RT] Error: Test control_p8 034 failed in check_result failed
[RT] Error: Test control_p8 034 failed in run_test failed
[RT] Error: Test control_qr_p8 036 failed in check_result failed
[RT] Error: Test control_qr_p8 036 failed in run_test failed
[RT] Error: Test control_decomp_p8 038 failed in check_result failed
[RT] Error: Test control_decomp_p8 038 failed in run_test failed
[RT] Error: Test control_2threads_p8 039 failed in check_result failed
[RT] Error: Test control_2threads_p8 039 failed in run_test failed
[RT] Error: Test control_p8_lndp 040 failed in check_result failed
[RT] Error: Test control_p8_lndp 040 failed in run_test failed
[RT] Error: Test control_p8_rrtmgp 041 failed in check_result failed
[RT] Error: Test control_p8_rrtmgp 041 failed in run_test failed
[RT] Error: Test control_p8_mynn 042 failed in check_result failed
[RT] Error: Test control_p8_mynn 042 failed in run_test failed
[RT] Error: Test merra2_thompson 043 failed in check_result failed
[RT] Error: Test merra2_thompson 043 failed in run_test failed
[RT] Error: Test regional_control 044 failed in check_result failed
[RT] Error: Test regional_control 044 failed in run_test failed
[RT] Error: Test regional_control_qr 046 failed in check_result failed
[RT] Error: Test regional_control_qr 046 failed in run_test failed
[RT] Error: Test regional_decomp 048 failed in check_result failed
[RT] Error: Test regional_decomp 048 failed in run_test failed
[RT] Error: Test regional_2threads 049 failed in check_result failed
[RT] Error: Test regional_2threads 049 failed in run_test failed
[RT] Error: Test regional_noquilt 050 failed in check_result failed
[RT] Error: Test regional_noquilt 050 failed in run_test failed
[RT] Error: Test regional_netcdf_parallel 051 failed in check_result failed
[RT] Error: Test regional_netcdf_parallel 051 failed in run_test failed
[RT] Error: Test regional_2dwrtdecomp 052 failed in check_result failed
[RT] Error: Test regional_2dwrtdecomp 052 failed in run_test failed
[RT] Error: Test regional_wofs 053 failed in check_result failed
[RT] Error: Test regional_wofs 053 failed in run_test failed
[RT] Error: Test rap_control 054 failed in check_result failed
[RT] Error: Test rap_control 054 failed in run_test failed
[RT] Error: Test regional_spp_sppt_shum_skeb 055 failed in check_result failed
[RT] Error: Test regional_spp_sppt_shum_skeb 055 failed in run_test failed
[RT] Error: Test rap_decomp 056 failed in check_result failed
[RT] Error: Test rap_decomp 056 failed in run_test failed
[RT] Error: Test rap_2threads 057 failed in check_result failed
[RT] Error: Test rap_2threads 057 failed in run_test failed
[RT] Error: Test rap_sfcdiff 059 failed in check_result failed
[RT] Error: Test rap_sfcdiff 059 failed in run_test failed
[RT] Error: Test rap_sfcdiff_decomp 060 failed in check_result failed
[RT] Error: Test rap_sfcdiff_decomp 060 failed in run_test failed
[RT] Error: Test hrrr_control 062 failed in check_result failed
[RT] Error: Test hrrr_control 062 failed in run_test failed
[RT] Error: Test hrrr_control_decomp 063 failed in check_result failed
[RT] Error: Test hrrr_control_decomp 063 failed in run_test failed
[RT] Error: Test hrrr_control_2threads 064 failed in check_result failed
[RT] Error: Test hrrr_control_2threads 064 failed in run_test failed
[RT] Error: Test rrfs_v1beta 066 failed in check_result failed
[RT] Error: Test rrfs_v1beta 066 failed in run_test failed
[RT] Error: Test rrfs_v1nssl 067 failed in check_result failed
[RT] Error: Test rrfs_v1nssl 067 failed in run_test failed
[RT] Error: Test rrfs_v1nssl_nohailnoccn 068 failed in check_result failed
[RT] Error: Test rrfs_v1nssl_nohailnoccn 068 failed in run_test failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm 069 failed in check_result failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm 069 failed in run_test failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_2threads 070 failed in check_result failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_2threads 070 failed in run_test failed
[RT] Error: Test rrfs_conus13km_hrrr_warm 071 failed in check_result failed
[RT] Error: Test rrfs_conus13km_hrrr_warm 071 failed in run_test failed
[RT] Error: Test rrfs_smoke_conus13km_radar_tten_warm 072 failed in check_result failed
[RT] Error: Test rrfs_smoke_conus13km_radar_tten_warm 072 failed in run_test failed
[RT] Error: Test control_csawmg 074 failed in check_result failed
[RT] Error: Test control_csawmg 074 failed in run_test failed
[RT] Error: Test control_csawmgt 075 failed in check_result failed
[RT] Error: Test control_csawmgt 075 failed in run_test failed
[RT] Error: Test control_ras 076 failed in check_result failed
[RT] Error: Test control_ras 076 failed in run_test failed
[RT] Error: Test control_wam 077 failed in check_result failed
[RT] Error: Test control_wam 077 failed in run_test failed
[RT] Error: Test control_p8_faster 078 failed in check_result failed
[RT] Error: Test control_p8_faster 078 failed in run_test failed
[RT] Error: Test regional_control_faster 079 failed in check_result failed
[RT] Error: Test regional_control_faster 079 failed in run_test failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_debug 080 failed in check_result failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_debug 080 failed in run_test failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_debug_2threads 081 failed in check_result failed
[RT] Error: Test rrfs_smoke_conus13km_hrrr_warm_debug_2threads 081 failed in run_test failed
[RT] Error: Test rrfs_conus13km_hrrr_warm_debug 082 failed in check_result failed
[RT] Error: Test rrfs_conus13km_hrrr_warm_debug 082 failed in run_test failed
[RT] Error: Test control_CubedSphereGrid_debug 083 failed in check_result failed
[RT] Error: Test control_CubedSphereGrid_debug 083 failed in run_test failed
[RT] Error: Test control_wrtGauss_netcdf_parallel_debug 084 failed in check_result failed
[RT] Error: Test control_wrtGauss_netcdf_parallel_debug 084 failed in run_test failed
[RT] Error: Test control_stochy_debug 085 failed in check_result failed
[RT] Error: Test control_stochy_debug 085 failed in run_test failed
[RT] Error: Test control_lndp_debug 086 failed in check_result failed
[RT] Error: Test control_lndp_debug 086 failed in run_test failed
[RT] Error: Test control_csawmg_debug 087 failed in check_result failed
[RT] Error: Test control_csawmg_debug 087 failed in run_test failed
[RT] Error: Test control_csawmgt_debug 088 failed in check_result failed
[RT] Error: Test control_csawmgt_debug 088 failed in run_test failed
[RT] Error: Test control_ras_debug 089 failed in check_result failed
[RT] Error: Test control_ras_debug 089 failed in run_test failed
[RT] Error: Test control_diag_debug 090 failed in check_result failed
[RT] Error: Test control_diag_debug 090 failed in run_test failed
[RT] Error: Test control_debug_p8 091 failed in check_result failed
[RT] Error: Test control_debug_p8 091 failed in run_test failed
[RT] Error: Test regional_debug 092 failed in check_result failed
[RT] Error: Test regional_debug 092 failed in run_test failed
[RT] Error: Test rap_control_debug 093 failed in check_result failed
[RT] Error: Test rap_control_debug 093 failed in run_test failed
[RT] Error: Test hrrr_control_debug 094 failed in check_result failed
[RT] Error: Test hrrr_control_debug 094 failed in run_test failed
[RT] Error: Test rap_unified_drag_suite_debug 095 failed in check_result failed
[RT] Error: Test rap_unified_drag_suite_debug 095 failed in run_test failed
[RT] Error: Test rap_diag_debug 096 failed in check_result failed
[RT] Error: Test rap_diag_debug 096 failed in run_test failed
[RT] Error: Test rap_cires_ugwp_debug 097 failed in check_result failed
[RT] Error: Test rap_cires_ugwp_debug 097 failed in run_test failed
[RT] Error: Test rap_unified_ugwp_debug 098 failed in check_result failed
[RT] Error: Test rap_unified_ugwp_debug 098 failed in run_test failed
[RT] Error: Test rap_lndp_debug 099 failed in check_result failed
[RT] Error: Test rap_lndp_debug 099 failed in run_test failed
[RT] Error: Test rap_flake_debug 100 failed in check_result failed
[RT] Error: Test rap_flake_debug 100 failed in run_test failed
[RT] Error: Test rap_progcld_thompson_debug 101 failed in check_result failed
[RT] Error: Test rap_progcld_thompson_debug 101 failed in run_test failed
[RT] Error: Test rap_noah_debug 102 failed in check_result failed
[RT] Error: Test rap_noah_debug 102 failed in run_test failed
[RT] Error: Test rap_sfcdiff_debug 103 failed in check_result failed
[RT] Error: Test rap_sfcdiff_debug 103 failed in run_test failed
[RT] Error: Test rap_noah_sfcdiff_cires_ugwp_debug 104 failed in check_result failed
[RT] Error: Test rap_noah_sfcdiff_cires_ugwp_debug 104 failed in run_test failed
[RT] Error: Test rrfs_v1beta_debug 105 failed in check_result failed
[RT] Error: Test rrfs_v1beta_debug 105 failed in run_test failed
[RT] Error: Test control_wam_debug 106 failed in check_result failed
[RT] Error: Test control_wam_debug 106 failed in run_test failed
[RT] Error: Test regional_spp_sppt_shum_skeb_dyn32_phy32 107 failed in check_result failed
[RT] Error: Test regional_spp_sppt_shum_skeb_dyn32_phy32 107 failed in run_test failed
[RT] Error: Test rap_control_dyn32_phy32 108 failed in check_result failed
[RT] Error: Test rap_control_dyn32_phy32 108 failed in run_test failed
[RT] Error: Test hrrr_control_dyn32_phy32 109 failed in check_result failed
[RT] Error: Test hrrr_control_dyn32_phy32 109 failed in run_test failed
[RT] Error: Test rap_2threads_dyn32_phy32 110 failed in check_result failed
[RT] Error: Test rap_2threads_dyn32_phy32 110 failed in run_test failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 111 failed in check_result failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 111 failed in run_test failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 112 failed in check_result failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 112 failed in run_test failed
[RT] Error: Test rap_control_dyn64_phy32 115 failed in check_result failed
[RT] Error: Test rap_control_dyn64_phy32 115 failed in run_test failed
[RT] Error: Test rap_control_debug_dyn32_phy32 116 failed in check_result failed
[RT] Error: Test rap_control_debug_dyn32_phy32 116 failed in run_test failed
[RT] Error: Test hrrr_control_debug_dyn32_phy32 117 failed in check_result failed
[RT] Error: Test hrrr_control_debug_dyn32_phy32 117 failed in run_test failed
[RT] Error: Test rap_control_dyn64_phy32_debug 118 failed in check_result failed
[RT] Error: Test rap_control_dyn64_phy32_debug 118 failed in run_test failed
[RT] Error: Test hafs_regional_atm 119 failed in check_result failed
[RT] Error: Test hafs_regional_atm 119 failed in run_test failed
[RT] Error: Test hafs_regional_atm_thompson_gfdlsf 120 failed in check_result failed
[RT] Error: Test hafs_regional_atm_thompson_gfdlsf 120 failed in run_test failed
[RT] Error: Test hafs_regional_atm_ocn 121 failed in check_result failed
[RT] Error: Test hafs_regional_atm_ocn 121 failed in run_test failed
[RT] Error: Test hafs_regional_atm_wav 122 failed in check_result failed
[RT] Error: Test hafs_regional_atm_wav 122 failed in run_test failed
[RT] Error: Test hafs_regional_atm_ocn_wav 123 failed in check_result failed
[RT] Error: Test hafs_regional_atm_ocn_wav 123 failed in run_test failed
[RT] Error: Test hafs_regional_1nest_atm 124 failed in check_result failed
[RT] Error: Test hafs_regional_1nest_atm 124 failed in run_test failed
[RT] Error: Test hafs_regional_telescopic_2nests_atm 125 failed in check_result failed
[RT] Error: Test hafs_regional_telescopic_2nests_atm 125 failed in run_test failed
[RT] Error: Test hafs_global_1nest_atm 126 failed in check_result failed
[RT] Error: Test hafs_global_1nest_atm 126 failed in run_test failed
[RT] Error: Test hafs_global_multiple_4nests_atm 127 failed in check_result failed
[RT] Error: Test hafs_global_multiple_4nests_atm 127 failed in run_test failed
[RT] Error: Test hafs_regional_specified_moving_1nest_atm 128 failed in check_result failed
[RT] Error: Test hafs_regional_specified_moving_1nest_atm 128 failed in run_test failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm 129 failed in check_result failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm 129 failed in run_test failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn 130 failed in check_result failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn 130 failed in run_test failed
[RT] Error: Test hafs_global_storm_following_1nest_atm 131 failed in check_result failed
[RT] Error: Test hafs_global_storm_following_1nest_atm 131 failed in run_test failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_debug 132 failed in check_result failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_debug 132 failed in run_test failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_wav 133 failed in check_result failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_wav 133 failed in run_test failed
[RT] Error: Test hafs_regional_docn 134 failed in check_result failed
[RT] Error: Test hafs_regional_docn 134 failed in run_test failed
[RT] Error: Test hafs_regional_docn_oisst 135 failed in check_result failed
[RT] Error: Test hafs_regional_docn_oisst 135 failed in run_test failed
[RT] Error: Test hafs_regional_datm_cdeps 136 failed in check_result failed
[RT] Error: Test hafs_regional_datm_cdeps 136 failed in run_test failed
[RT] Error: Test datm_cdeps_control_cfsr 137 failed in check_result failed
[RT] Error: Test datm_cdeps_control_cfsr 137 failed in run_test failed
[RT] Error: Test datm_cdeps_control_gefs 139 failed in check_result failed
[RT] Error: Test datm_cdeps_control_gefs 139 failed in run_test failed
[RT] Error: Test datm_cdeps_iau_gefs 140 failed in check_result failed
[RT] Error: Test datm_cdeps_iau_gefs 140 failed in run_test failed
[RT] Error: Test datm_cdeps_stochy_gefs 141 failed in check_result failed
[RT] Error: Test datm_cdeps_stochy_gefs 141 failed in run_test failed
[RT] Error: Test datm_cdeps_ciceC_cfsr 142 failed in check_result failed
[RT] Error: Test datm_cdeps_ciceC_cfsr 142 failed in run_test failed
[RT] Error: Test datm_cdeps_bulk_cfsr 143 failed in check_result failed
[RT] Error: Test datm_cdeps_bulk_cfsr 143 failed in run_test failed
[RT] Error: Test datm_cdeps_bulk_gefs 144 failed in check_result failed
[RT] Error: Test datm_cdeps_bulk_gefs 144 failed in run_test failed
[RT] Error: Test datm_cdeps_mx025_cfsr 145 failed in check_result failed
[RT] Error: Test datm_cdeps_mx025_cfsr 145 failed in run_test failed
[RT] Error: Test datm_cdeps_mx025_gefs 146 failed in check_result failed
[RT] Error: Test datm_cdeps_mx025_gefs 146 failed in run_test failed
[RT] Error: Test datm_cdeps_multiple_files_cfsr 147 failed in check_result failed
[RT] Error: Test datm_cdeps_multiple_files_cfsr 147 failed in run_test failed
[RT] Error: Test datm_cdeps_3072x1536_cfsr 148 failed in check_result failed
[RT] Error: Test datm_cdeps_3072x1536_cfsr 148 failed in run_test failed
[RT] Error: Test datm_cdeps_gfs 149 failed in check_result failed
[RT] Error: Test datm_cdeps_gfs 149 failed in run_test failed
[RT] Error: Test datm_cdeps_debug_cfsr 150 failed in check_result failed
[RT] Error: Test datm_cdeps_debug_cfsr 150 failed in run_test failed
[RT] Error: Test datm_cdeps_control_cfsr_faster 151 failed in check_result failed
[RT] Error: Test datm_cdeps_control_cfsr_faster 151 failed in run_test failed
[RT] Error: Test datm_cdeps_lnd_gswp3 152 failed in check_result failed
[RT] Error: Test datm_cdeps_lnd_gswp3 152 failed in run_test failed
[RT] Error: Test control_p8_atmlnd_sbs 154 failed in check_result failed
[RT] Error: Test control_p8_atmlnd_sbs 154 failed in run_test failed
[RT] Error: Test atmwav_control_noaero_p8 155 failed in check_result failed
[RT] Error: Test atmwav_control_noaero_p8 155 failed in run_test failed
[RT] Error: Test control_atmwav 156 failed in check_result failed
[RT] Error: Test control_atmwav 156 failed in run_test failed
[RT] Error: Test atmaero_control_p8 157 failed in check_result failed
[RT] Error: Test atmaero_control_p8 157 failed in run_test failed
[RT] Error: Test atmaero_control_p8_rad 158 failed in check_result failed
[RT] Error: Test atmaero_control_p8_rad 158 failed in run_test failed
[RT] Error: Test atmaero_control_p8_rad_micro 159 failed in check_result failed
[RT] Error: Test atmaero_control_p8_rad_micro 159 failed in run_test failed
[RT] Error: Test regional_atmaq 160 failed in check_result failed
[RT] Error: Test regional_atmaq 160 failed in run_test failed
[RT] Error: Test regional_atmaq_faster 161 failed in check_result failed
[RT] Error: Test regional_atmaq_faster 161 failed in run_test failed
Please make changes and add the following label back: cheyenne-intel-RT

@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: intel
Job: RT
[RT] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230503212803/ufs-weather-model
[RT] Error: Test cpld_bmark_p8 013 failed in check_result failed
[RT] Error: Test cpld_bmark_p8 013 failed in run_test failed
[RT] Error: Test control_latlon 026 failed in check_result failed
[RT] Error: Test control_latlon 026 failed in run_test failed
[RT] Error: Test control_wrtGauss_netcdf_parallel 027 failed in check_result failed
[RT] Error: Test control_wrtGauss_netcdf_parallel 027 failed in run_test failed
[RT] Error: Test control_c192 029 failed in check_result failed
[RT] Error: Test control_c192 029 failed in run_test failed
[RT] Error: Test control_c384 030 failed in check_result failed
[RT] Error: Test control_c384 030 failed in run_test failed
[RT] Error: Test control_c384gdas 031 failed in check_result failed
[RT] Error: Test control_c384gdas 031 failed in run_test failed
[RT] Error: Test control_stochy 032 failed in check_result failed
[RT] Error: Test control_stochy 032 failed in run_test failed
[RT] Error: Test control_lndp 034 failed in check_result failed
[RT] Error: Test control_lndp 034 failed in run_test failed
[RT] Error: Test control_iovr4 035 failed in check_result failed
[RT] Error: Test control_iovr4 035 failed in run_test failed
[RT] Error: Test control_iovr5 036 failed in check_result failed
[RT] Error: Test control_iovr5 036 failed in run_test failed
[RT] Error: Test control_p8 037 failed in check_result failed
[RT] Error: Test control_p8 037 failed in run_test failed
[RT] Error: Test control_qr_p8 039 failed in check_result failed
[RT] Error: Test control_qr_p8 039 failed in run_test failed
[RT] Error: Test control_decomp_p8 041 failed in check_result failed
[RT] Error: Test control_decomp_p8 041 failed in run_test failed
[RT] Error: Test control_2threads_p8 042 failed in check_result failed
[RT] Error: Test control_2threads_p8 042 failed in run_test failed
[RT] Error: Test control_p8_lndp 043 failed in check_result failed
[RT] Error: Test control_p8_lndp 043 failed in run_test failed
[RT] Error: Test control_p8_rrtmgp 044 failed in check_result failed
[RT] Error: Test control_p8_rrtmgp 044 failed in run_test failed
[RT] Error: Test control_p8_mynn 045 failed in check_result failed
[RT] Error: Test control_p8_mynn 045 failed in run_test failed
[RT] Error: Test merra2_thompson 046 failed in check_result failed
[RT] Error: Test merra2_thompson 046 failed in run_test failed
[RT] Error: Test rap_control 057 failed in check_result failed
[RT] Error: Test rap_control 057 failed in run_test failed
[RT] Error: Test regional_spp_sppt_shum_skeb 058 failed in check_result failed
[RT] Error: Test regional_spp_sppt_shum_skeb 058 failed in run_test failed
[RT] Error: Test rap_decomp 059 failed in check_result failed
[RT] Error: Test rap_decomp 059 failed in run_test failed
[RT] Error: Test rap_2threads 060 failed in check_result failed
[RT] Error: Test rap_2threads 060 failed in run_test failed
[RT] Error: Test rap_sfcdiff 062 failed in check_result failed
[RT] Error: Test rap_sfcdiff 062 failed in run_test failed
[RT] Error: Test rap_sfcdiff_decomp 063 failed in check_result failed
[RT] Error: Test rap_sfcdiff_decomp 063 failed in run_test failed
[RT] Error: Test hrrr_control 065 failed in check_result failed
[RT] Error: Test hrrr_control 065 failed in run_test failed
[RT] Error: Test hrrr_control_decomp 066 failed in check_result failed
[RT] Error: Test hrrr_control_decomp 066 failed in run_test failed
[RT] Error: Test hrrr_control_2threads 067 failed in check_result failed
[RT] Error: Test hrrr_control_2threads 067 failed in run_test failed
[RT] Error: Test rrfs_v1beta 069 failed in check_result failed
[RT] Error: Test rrfs_v1beta 069 failed in run_test failed
[RT] Error: Test rrfs_v1nssl 070 failed in check_result failed
[RT] Error: Test rrfs_v1nssl 070 failed in run_test failed
[RT] Error: Test rrfs_v1nssl_nohailnoccn 071 failed in check_result failed
[RT] Error: Test rrfs_v1nssl_nohailnoccn 071 failed in run_test failed
[RT] Error: Test control_csawmg 077 failed in check_result failed
[RT] Error: Test control_csawmg 077 failed in run_test failed
[RT] Error: Test control_csawmgt 078 failed in check_result failed
[RT] Error: Test control_csawmgt 078 failed in run_test failed
[RT] Error: Test control_ras 079 failed in check_result failed
[RT] Error: Test control_ras 079 failed in run_test failed
[RT] Error: Test control_p8_faster 081 failed in check_result failed
[RT] Error: Test control_p8_faster 081 failed in run_test failed
[RT] Error: Test regional_spp_sppt_shum_skeb_dyn32_phy32 110 failed in check_result failed
[RT] Error: Test regional_spp_sppt_shum_skeb_dyn32_phy32 110 failed in run_test failed
[RT] Error: Test rap_control_dyn32_phy32 111 failed in check_result failed
[RT] Error: Test rap_control_dyn32_phy32 111 failed in run_test failed
[RT] Error: Test hrrr_control_dyn32_phy32 112 failed in check_result failed
[RT] Error: Test hrrr_control_dyn32_phy32 112 failed in run_test failed
[RT] Error: Test rap_2threads_dyn32_phy32 113 failed in check_result failed
[RT] Error: Test rap_2threads_dyn32_phy32 113 failed in run_test failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 114 failed in check_result failed
[RT] Error: Test hrrr_control_2threads_dyn32_phy32 114 failed in run_test failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 115 failed in check_result failed
[RT] Error: Test hrrr_control_decomp_dyn32_phy32 115 failed in run_test failed
[RT] Error: Test rap_control_dyn64_phy32 118 failed in check_result failed
[RT] Error: Test rap_control_dyn64_phy32 118 failed in run_test failed
[RT] Error: Test hafs_regional_atm_wav 125 failed in check_result failed
[RT] Error: Test hafs_regional_atm_wav 125 failed in run_test failed
[RT] Error: Test hafs_regional_atm_ocn_wav 126 failed in check_result failed
[RT] Error: Test hafs_regional_atm_ocn_wav 126 failed in run_test failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_wav 136 failed in check_result failed
[RT] Error: Test hafs_regional_storm_following_1nest_atm_ocn_wav 136 failed in run_test failed
[RT] Error: Test atmwav_control_noaero_p8 158 failed in check_result failed
[RT] Error: Test atmwav_control_noaero_p8 158 failed in run_test failed
[RT] Error: Test control_atmwav 159 failed in check_result failed
[RT] Error: Test control_atmwav 159 failed in run_test failed
[RT] Error: Test atmaero_control_p8 160 failed in check_result failed
[RT] Error: Test atmaero_control_p8 160 failed in run_test failed
[RT] Error: Test atmaero_control_p8_rad 161 failed in check_result failed
[RT] Error: Test atmaero_control_p8_rad 161 failed in run_test failed
[RT] Error: Test atmaero_control_p8_rad_micro 162 failed in check_result failed
[RT] Error: Test atmaero_control_p8_rad_micro 162 failed in run_test failed
Please make changes and add the following label back: hera-intel-RT

@grantfirl
Copy link
Collaborator Author

@dustinswales The Hera RT failures are as expected. Cheyenne/intel has more failures than expected due to this PR alone, although BL creation from Cheyenne/intel was blocked due to space issues in #95, so this is also expected. I'm going to update BL_DATE and run the BL creation tags.

on-behalf-of @NCAR <dswales@ucar.edu>
@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: gnu
Job: BL
[BL] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230504144514/ufs-weather-model
[BL] Baseline creation and move successful
[RT] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230504164412/ufs-weather-model
Please make changes and add the following label back: hera-gnu-BL

on-behalf-of @NCAR <dswales@ucar.edu>
@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: intel
Job: BL
[BL] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230504181926/ufs-weather-model
[BL] Baseline creation and move successful
[RT] Repo location: /scratch1/BMC/gmtb/RT/auto_RT/Pull_Requests/1327670543/20230504194322/ufs-weather-model
Please make changes and add the following label back: hera-intel-BL

@grantfirl
Copy link
Collaborator Author

@dustinswales I'm not sure what happened with the autoRTs on Cheyenne. The GNU test completed, but it was unable to finish the script and upload the log. I copied the log from /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230504091926/ufs-weather-model/tests and manually pushed it.

@grantfirl
Copy link
Collaborator Author

@dustinswales Do you mind stopping and restarting the autoRT setup on Cheyenne? The intel RTs won't start and it looks like start_rt_auto.sh is still running.

@dustinswales
Copy link
Collaborator

@dustinswales I'm not sure what happened with the autoRTs on Cheyenne. The GNU test completed, but it was unable to finish the script and upload the log. I copied the log from /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230504091926/ufs-weather-model/tests and manually pushed it.

@grantfirl Weird, the auto-rt log shows the same thing, /glade/u/home/dswales/Projects/UFS/auto-RT/ufs-weather-model/tests/auto/rt_auto_20230504084504.log. Not sure why it failed when pushing the logs?

@dustinswales
Copy link
Collaborator

@dustinswales Do you mind stopping and restarting the autoRT setup on Cheyenne? The intel RTs won't start and it looks like start_rt_auto.sh is still running.

Done.
FYI, I think I know what happened. Sometime ago I added a lockfile to the main script, /glade/u/home/dswales/Projects/UFS/auto-RT/ufs-weather-model/tests/auto/start_rt_auto.sh, which was causing the script to hang in some situations. I just removed this piece (and will do the same on Hera).

on-behalf-of @NCAR <dswales@ucar.edu>
@dustinswales
Copy link
Collaborator

Automated RT Failure Notification
Machine: cheyenne
Compiler: intel
Job: BL
[BL] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230505101511/ufs-weather-model
[BL] Baseline creation and move successful
[RT] Repo location: /glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT/auto_RT/Pull_Requests/1327670543/20230505143217/ufs-weather-model
Please make changes and add the following label back: cheyenne-intel-BL

@grantfirl
Copy link
Collaborator Author

@dustinswales Please approve this and submodule PRs when you get a chance.

@grantfirl grantfirl requested a review from dustinswales May 8, 2023 15:14
@grantfirl grantfirl merged commit cea5b70 into NCAR:main May 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants