Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update develop-ref after dtcenter/MET#2918 #2922

Merged
merged 100 commits into from
Jun 21, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
100 commits
Select commit Hold shift + click to select a range
d8572b9
2673 Moved dvariable declaration after include
Feb 2, 2024
6ebfdac
#2673 Move down namespace below include
Feb 2, 2024
c788602
Feature #2395 wdir (#2820)
JohnHalleyGotway Feb 14, 2024
67ee04e
Recent changes to branch protection rules for the develop branch have…
JohnHalleyGotway Feb 15, 2024
b558794
Feature #2280 ens_prob (#2823)
JohnHalleyGotway Feb 22, 2024
069cdbd
Merge remote-tracking branch 'origin/develop' into feature_2673_sonar…
Feb 22, 2024
7f513eb
#2673 Change 0 to nullptr
Feb 27, 2024
7483636
#2673 Change 0 to nullptr
Feb 27, 2024
f33de8e
#2673 Change 0 to nullptr
Feb 27, 2024
c1e99ea
#2673 Change 0 to nullptr
Feb 27, 2024
6c30e49
#2673 Change 0 to nullptr
Feb 27, 2024
5cca97e
Merge pull request #2827 from dtcenter/feature_2673_sonarqube_beta3_n…
hsoh-u Feb 27, 2024
83730cf
#2673 Removed the redundant parentheses with return
Feb 28, 2024
4d60e06
#2673 Removed the redundant parentheses with return
Feb 28, 2024
3ff3767
#2673 Removed the redundant parentheses with return
Feb 28, 2024
55f5d3e
#2673 Removed the redundant parentheses with return
Feb 28, 2024
6bb41bc
#2673 Removed the redundant parentheses with return
Feb 28, 2024
d82a979
#2673 Merged develop branch
Feb 28, 2024
481bb15
#2673 restored return statement
Feb 28, 2024
00b162b
Merge pull request #2828 from dtcenter/feature_2673_sonarqube_beta3_r…
hsoh-u Feb 28, 2024
bc7af99
#2673 Added std namespace
Feb 28, 2024
e872917
#2673 Moved down 'using namespace' statement. Removed trailing spaces
Feb 28, 2024
3eb4367
#2673 Moved down 'using namespace' statement.
Mar 1, 2024
3f92f6a
#2673 Moved down 'using namespace' statement.
Mar 1, 2024
a00c7be
#2673 Moved down 'using namespace' statement.
Mar 1, 2024
5706e97
#2673 Moved down 'using namespace' statement.
Mar 1, 2024
4821c37
Merge remote-tracking branch 'origin/develop' into feature_2673_sonar…
Mar 1, 2024
2509f7c
#2673 Added std namespace
Mar 5, 2024
ca64f00
#2673 Added std namespace
Mar 5, 2024
a7f0e06
#2673 Added std namespace
Mar 5, 2024
0b2a7da
Merge pull request #2831 from dtcenter/feature_2673_sonarqube_beta3_n…
hsoh-u Mar 6, 2024
0ab2466
#2673 Changed literal 1 to boolean value, true
Mar 6, 2024
4d7d4a2
Merge pull request #2832 from dtcenter/feature_2673_sonarqube_1_to_true
hsoh-u Mar 7, 2024
a6f7646
Feature #2673 enum_to_string (#2835)
JohnHalleyGotway Mar 14, 2024
108a895
Feature #2583 ecnt (#2825)
JohnHalleyGotway Mar 14, 2024
4c322aa
Revert #2825 since more documentation and testing is needed (#2837)
JohnHalleyGotway Mar 14, 2024
fd1b250
Feature #2583 ecnt fix IGN_OERR_CORR (#2838)
JohnHalleyGotway Mar 14, 2024
f113181
Update the pull request template to include a question about expected…
JohnHalleyGotway Mar 14, 2024
be3ce26
#2830 Changed enum Builtin to enum class
Mar 19, 2024
0153110
#2830 Converted enum to enum class at config_constants.h
Mar 19, 2024
0a771d4
Feature #2830 bootstrap enum (#2843)
JohnHalleyGotway Mar 23, 2024
98af717
Bugfix #2833 develop azimuth (#2840)
JohnHalleyGotway Mar 27, 2024
1c97607
#2830 Changed enum PadSize to enum class
Mar 27, 2024
40b67d4
#2830 Removed redundant parantheses
Mar 27, 2024
79f81af
#2830 Removed commenyted out code
Mar 27, 2024
cef8aad
Merge remote-tracking branch 'origin/develop' into feature_2830_sonar…
Mar 27, 2024
8cc667c
#2830 Use auto
Mar 27, 2024
d6cba7d
#2830 Changed enum to enum class for DistType, InterpMthd, GridTempla…
Mar 28, 2024
15987a1
#2830 Moved enum_class_as_integer from header file to cc files
Mar 28, 2024
8a277fa
#2830 Added enum_as_int.hpp
Apr 1, 2024
fa41fa3
#2830 Added enum_as_int.hpp
Apr 1, 2024
5c95525
Deleted enum_class_as_integer and renamed it to enum_class_as_int
Apr 1, 2024
62acda7
Removed redundant paranthese
Apr 1, 2024
6ac387f
#2830 Changed enum to enumclass
Apr 1, 2024
175f4ed
#2830 Changed enum_class_as_integer to enum_class_as_int
Apr 1, 2024
2c72a1b
Feature #2379 sonarqube gha (#2847)
JohnHalleyGotway Apr 2, 2024
a72e8c5
Hotfix related to #2379. The sonar.newCode.referenceBranch and sonar.…
JohnHalleyGotway Apr 2, 2024
2bef141
#2830 Changed enum STATJobType to enum class
Apr 3, 2024
9e0cd6d
#2830 Changed STATLineType to enum class
Apr 5, 2024
8fad8f2
#2830 Changed Action to enum class
Apr 5, 2024
6d8a3c7
#2830 Changed ModeDataType to enum class
Apr 5, 2024
df25b86
#2830 Changed StepCase to enum class
Apr 5, 2024
1f1d525
#2830 Changed enum to enum class
Apr 5, 2024
aebdd2a
#2830 Changed GenesisPairCategory to enum class
Apr 5, 2024
00380dc
#2830 Removed rediundabt parenrthese
Apr 5, 2024
42c453e
#2830 Reduced same if checking
Apr 5, 2024
2bd5dcf
#2830 Cleanup
Apr 5, 2024
1f32746
#2830 USe empty() instead of lebgth checking
Apr 5, 2024
0811740
#2830 Adjusted indentations
Apr 5, 2024
e71debf
Feature #2379 develop sonarqube updates (#2850)
JohnHalleyGotway Apr 8, 2024
78f1824
Merge remote-tracking branch 'origin/develop' into feature_2830_sonar…
JohnHalleyGotway Apr 8, 2024
3d543fc
Merge pull request #2849 from dtcenter/feature_2830_sonarqube_enum
hsoh-u Apr 8, 2024
2a26d59
Feature 2654 ascii2nc polar buoy support (#2846)
davidalbo Apr 10, 2024
f78720b
Feature #2786 rpss_from_prob (#2861)
JohnHalleyGotway Apr 17, 2024
947b061
Feature #2862 v12.0.0-beta4 (#2864)
JohnHalleyGotway Apr 17, 2024
406d991
Feature #2379 develop single_sq_project (#2865)
JohnHalleyGotway Apr 18, 2024
0a219b5
Hotfix to the documentation in the develop branch. Issue #2858 was cl…
JohnHalleyGotway Apr 18, 2024
d4c4eba
Feature 2842 ugrid config (#2852)
hsoh-u Apr 25, 2024
3caffb4
Feature 2753 comp script config (#2868)
jprestop Apr 29, 2024
d3ecc87
Feature #2795 level_mismatch_warning (#2873)
JohnHalleyGotway Apr 30, 2024
ccd1061
Feature #2870 removing_MISSING_warning (#2872)
JohnHalleyGotway May 1, 2024
7f9bf9c
Feature 2842 ugrid config (#2875)
hsoh-u May 1, 2024
566d4fb
Hotfix to develop branch to remove duplicate test named 'point_stat_u…
JohnHalleyGotway May 1, 2024
542b4ba
Feature 2748 document ugrid (#2869)
DanielAdriaansen May 7, 2024
79ac568
Feature #2781 Convert MET NetCDF point obs to Pandas DataFrame (#2877)
georgemccabe May 8, 2024
a960cc6
Feature #2833 pcp_combine_missing (#2886)
JohnHalleyGotway May 15, 2024
27bff62
Per #2888, update STATAnalysisJob::dump_stat_line() to support dumpin…
JohnHalleyGotway May 16, 2024
32bd12d
Per #2659, making updates as proposed at the 20240516 MET Eng. Mtg. (…
jprestop May 21, 2024
889f1b2
Feature #2395 TOTAL_DIR (#2892)
JohnHalleyGotway May 22, 2024
663fda7
Bugfix #2897 develop python_valid_time (#2899)
JohnHalleyGotway May 22, 2024
cd2b429
Bugfix 2867 point2grid qc flag (#2890)
hsoh-u May 22, 2024
66dca0d
Hotfix to develop to fix the update_truth.yml workflow logic. This te…
JohnHalleyGotway May 23, 2024
942959e
Avoid pushing directly to the develop or main_vX.Y branches since tha…
JohnHalleyGotway May 23, 2024
f368db9
#2904 Changed R path to R-4.4.0 (#2905)
hsoh-u Jun 7, 2024
bdcfcf8
Feature #2912 pb2nc error (#2914)
JohnHalleyGotway Jun 12, 2024
6f75e5a
Feature 2717 convert unit.pl to unit.py (#2871)
natalieb-noaa Jun 12, 2024
4179f55
Bugfix 2867 point2grid qc unittest (#2913)
hsoh-u Jun 14, 2024
95ad048
Feature #2911 tc_stat_set_hdr (#2916)
JohnHalleyGotway Jun 18, 2024
5f20f55
Bugfix #2856 develop ens_climo (#2918)
JohnHalleyGotway Jun 20, 2024
eb448e1
Merge remote-tracking branch 'origin/develop-ref' into update_develop…
metplus-bot Jun 21, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 20 additions & 1 deletion .github/jobs/set_job_controls.sh
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,12 @@ elif [ "${GITHUB_EVENT_NAME}" == "push" ]; then
input_data_version=${branch_name:6}
fi

# check for main_vX.Y in the branch name
elif [[ "${branch_name}" =~ .*(main_v)([0-9]+\.[0-9]+).* ]]; then

truth_data_version=${BASH_REMATCH[1]}${BASH_REMATCH[2]}
input_data_version=${BASH_REMATCH[2]}

fi

# check commit messages for skip or force keywords
Expand Down Expand Up @@ -87,14 +93,27 @@ elif [ "${GITHUB_EVENT_NAME}" == "push" ]; then

elif [ "${GITHUB_EVENT_NAME}" == "workflow_dispatch" ]; then

branch_name=`cut -d "/" -f3 <<< "${GITHUB_REF}"`

# check for main_vX.Y in the branch name
if [[ "${branch_name}" =~ .*(main_v)([0-9]+\.[0-9]+).* ]]; then

truth_data_version=${BASH_REMATCH[1]}${BASH_REMATCH[2]}
input_data_version=${BASH_REMATCH[2]}

fi

if [ "${force_tests}" == "true" ]; then

run_diff=true

fi

fi

# if updating truth or running diff, run unit tests
if [ "$run_update_truth" == "true" ] || [ "$run_diff" == "true" ]; then
if [ "$run_update_truth" == "true" ] ||
[ "$run_diff" == "true" ]; then

run_unit_tests=true

Expand Down
1 change: 1 addition & 0 deletions internal/test_unit/config/EnsembleStatConfig_climo
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ fcst = {

field = [
{ name = "TMP"; level = "Z2"; message_type = [ "ADPSFC" ]; },
{ name = "TMP"; level = "Z2"; message_type = [ "ADPSFC" ]; prob_cat_thresh = [ >275, >280, >285 ]; },
{ name = "TMP"; level = "P850"; message_type = [ "ADPUPA" ]; }
];
}
Expand Down
8 changes: 5 additions & 3 deletions src/libcode/vx_stat_out/stat_columns.cc
Original file line number Diff line number Diff line change
Expand Up @@ -3388,11 +3388,13 @@ void write_pjc_cols(const PCTInfo &pct_info,
col++;

at.set_entry(r, col, // OY_TP
pct_info.pct.event_count_by_row(i)/(double) n);
(n == 0 ? bad_data_double :
pct_info.pct.event_count_by_row(i)/(double) n));
col++;

at.set_entry(r, col, // ON_TP
pct_info.pct.nonevent_count_by_row(i)/(double) n);
(n == 0 ? bad_data_double :
pct_info.pct.nonevent_count_by_row(i)/(double) n));
col++;

at.set_entry(r, col, // CALIBRATION
Expand Down Expand Up @@ -3483,7 +3485,7 @@ void write_eclv_cols(const TTContingencyTable &ct,
//
// Economic Cost/Loss Value
// Dump out the ECLV line:
// TOTAL, BASER, BASER_VALUE,
// TOTAL, BASER, VALUE_BASER,
// N_PNT, [CL_], [VALUE_] (for each point)
//
at.set_entry(r, c+0, // Total Number of pairs
Expand Down
9 changes: 7 additions & 2 deletions src/libcode/vx_statistics/contable_nx2.cc
Original file line number Diff line number Diff line change
Expand Up @@ -467,15 +467,20 @@ return x;

double Nx2ContingencyTable::baser() const {

return (double) event_col_total()/n();
double v;

if( n() == 0 ) v = bad_data_double;
else v = (double) event_col_total()/n();

return ( v );
}


////////////////////////////////////////////////////////////////////////


double Nx2ContingencyTable::baser_ci(double alpha,
double &cl, double &cu) const {
double &cl, double &cu) const {
double v;

v = baser();
Expand Down
2 changes: 2 additions & 0 deletions src/libcode/vx_statistics/contable_stats.cc
Original file line number Diff line number Diff line change
Expand Up @@ -737,6 +737,8 @@ double TTContingencyTable::sedi_ci(double alpha,
double TTContingencyTable::cost_loss(double r) const {
double num, den, h, m, f, b, v;

if(n() == 0) return(bad_data_double);

// Total proportion of hits, misses, false alarms, and observations
h = (double) fy_oy() / n();
m = (double) fn_oy() / n();
Expand Down
3 changes: 3 additions & 0 deletions src/tools/core/ensemble_stat/ensemble_stat.cc
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,7 @@
// 041 04/16/24 Halley Gotway MET #2786 Compute RPS from climo bin probs.
// 042 04/29/24 Halley Gotway MET #2870 Ignore MISSING keyword.
// 043 04/29/24 Halley Gotway MET #2795 Move level mismatch warning.
// 044 06/17/24 Halley Gotway MET #2856 Reinitialize climo_cdf pointer
//
////////////////////////////////////////////////////////////////////////

Expand Down Expand Up @@ -2257,6 +2258,7 @@ void do_pct_cat_thresh(const EnsembleStatVxOpt &vx_opt,

// Re-initialize
pd_pnt.erase();
pd_pnt.set_climo_cdf_info_ptr(&vx_opt.cdf_info);

// Process the observations
for(i_obs=0; i_obs<pd_ens.n_obs; i_obs++) {
Expand Down Expand Up @@ -2355,6 +2357,7 @@ void do_pct_cdp_thresh(const EnsembleStatVxOpt &vx_opt,

// Re-initialize
pd_pnt.erase();
pd_pnt.set_climo_cdf_info_ptr(&vx_opt.cdf_info);

// Process the observations
for(i_obs=0; i_obs<pd_ens.n_obs; i_obs++) {
Expand Down
18 changes: 9 additions & 9 deletions src/tools/core/ensemble_stat/ensemble_stat_conf_info.cc
Original file line number Diff line number Diff line change
Expand Up @@ -1094,28 +1094,28 @@ int EnsembleStatVxOpt::n_txt_row(int i_txt_row) const {
case(i_prc):

// Maximum number of PCT, PJC, and PRC lines possible =
// Point Vx: Message Types * Masks * Interpolations * Categorical Thresholds
// Grid Vx: Masks * Interpolations * Categorical Thresholds
// Point Vx: Message Types * Masks * Interpolations * Categorical Thresholds * Climo CDF Bins
// Grid Vx: Masks * Interpolations * Categorical Thresholds * Climo CDF Bins
n = (get_n_msg_typ() + 1) * get_n_mask() * get_n_interp() *
get_n_prob_cat_thresh();
max(fcat_ta.n(), 1) * cdf_info.cdf_ta.n();
break;

case(i_pstd):

// Maximum number of PSTD lines possible =
// Point Vx: Message Types * Masks * Interpolations * Categorical Thresholds * Alphas
// Grid Vx: Masks * Interpolations * Categorical Thresholds * Alphas
// Point Vx: Message Types * Masks * Interpolations * Categorical Thresholds * Climo CDF Bins * Alphas
// Grid Vx: Masks * Interpolations * Categorical Thresholds * Climo CDF Bins * Alphas
n = (get_n_msg_typ() + 1) * get_n_mask() * get_n_interp() *
get_n_prob_cat_thresh() * get_n_ci_alpha();
max(fcat_ta.n(), 1) * cdf_info.cdf_ta.n() * get_n_ci_alpha();
break;

case(i_eclv):

// Maximum number of ECLV lines possible =
// Point Vx: Message Types * Masks * Interpolations * Probability Thresholds
// Grid Vx: Masks * Interpolations * Probability Thresholds
// Point Vx: Message Types * Masks * Interpolations * Probability Thresholds * Climo CDF Bins
// Grid Vx: Masks * Interpolations * Probability Thresholds * Climo CDF Bins
n = (get_n_msg_typ() + 1) * get_n_mask() * get_n_interp() *
get_n_prob_cat_thresh() * get_n_prob_cat_thresh();
get_n_prob_cat_thresh() * get_n_prob_cat_thresh() * cdf_info.cdf_ta.n();
break;

default:
Expand Down