Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update develop-ref after #1990, #1992, and #1994 #1995

Merged
merged 25 commits into from
Dec 14, 2021
Merged

Conversation

JohnHalleyGotway
Copy link
Collaborator

Pull Request Testing

This updates develop-ref to get past changes flagged in NB20211213.

  • Describe testing already performed for these changes:

    The differences are caused by caused by 3 PR's for 3 issues:
  1. PR Feature 1989 sort #1990 for Issue Sort files read from directories to provide consistent behavior across platforms. #1989 modifies the order of the output written by the unit tests:
file1: MET-develop-ref/test_output/met_test_scripts/stat_analysis/job_filter_SL1L2.stat
ERROR: header information mismatch in column FCST_VAR
ERROR: failed tests for SL1L2: hdr
--
file1: MET-develop-ref/test_output/tc_gen/tc_gen_2016_genmpr.txt
ERROR: header information mismatch in column FCST_VALID_BEG
ERROR: failed tests for GENMPR: hdr
--
file1: MET-develop-ref/test_output/tc_gen/tc_gen_2016.stat
ERROR: header information mismatch in column FCST_VALID_BEG
ERROR: failed tests for GENMPR: hdr
  1. PR Feature 1991 vcnt #1992 for Issue Fix Point-Stat and Grid-Stat to write VCNT output even if no VL1L2 or VAL1L2 output is requested. #1991 adds VCNT output lines for existing Fourier runs.
file1: MET-develop-ref/test_output/grid_stat/grid_stat_GFS_FOURIER_240000L_20120410_000000V.stat
ERROR: differing number of rows 1 vs. 5 for row type VCNT between versions 10_1 vs. 10_1 
ERROR: failed tests for VCNT: nrow
  1. PR Feature 1993 grid_mask #1994 for Issue Fix Gen-Vx-Mask to handle named grids and grid specification strings for -type grid #1993 adds 2 new output files from unit_gen_vx_mask.
ERROR: folder MET-develop-ref/test_output missing 2 files
    gen_vx_mask/GRID_NAMED_GRIDS_mask.nc 
    gen_vx_mask/GRID_SPEC_STRINGS_mask.nc 

These changes are all expected.

  • Recommend testing for the reviewer(s) to perform, including the location of input datasets, and any additional instructions:

    None

  • Do these changes include sufficient documentation updates, ensuring that no errors or warnings exist in the build of the documentation? [Yes]

  • Do these changes include sufficient testing updates? [Yes]

  • Will this PR result in changes to the test suite? [Yes]

    If yes, describe the new output and/or changes to the existing output:

    Update reference version, as expected.

  • Please complete this pull request review by [Fill in date].

Pull Request Checklist

See the METplus Workflow for details.

  • Complete the PR definition above.
  • Ensure the PR title matches the feature or bugfix branch name.
  • Define the PR metadata, as permissions allow.
    Select: Reviewer(s)
    Select: Organization level software support Project or Repository level development cycle Project
    Select: Milestone as the version that will include these changes
  • After submitting the PR, select Linked issues with the original issue number.
  • After the PR is approved, merge your changes. If permissions do not allow this, request that the reviewer do the merge.
  • Close the linked issue and delete your feature or bugfix branch from GitHub.

jprestop and others added 25 commits October 26, 2021 13:08
…tead of only the filename so that the function can tell whether or not the file exists. (#1952)

Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu>
* Per issue #1761 in set_perc() adding code to get FBIAS numeric value, like 1.0 or 0.9, etc. SL

* Per issue #1761: in set_perc(), modified actual percentile calculation at end to use the extracted FBIAS numeric value (float). SL

* Per issue #1761: modified the check on the perc_thresh_freq_bias, just has to be > 0 now. SL

* Per issue #1761: cleaned up code in set_perc(). SL

* Per #1761, updates to Simple_Node::set_perc() to handle variable frequency bias amounts.
Changes include:
- Reverting the formatting of this back to how it originally was in the develop branch. In general, just match the formatting of the existing file, so as the minimize the number of difference lines.
- Add logic to adjust the percentile to be found based on the requested FBIAS value. Multiplying or dividing the percentile by the FBIAS value depends on the inequality type and whether we're bias adjusting the forecast or observation data.
- Adjust the log messages slightly.

Please be aware that I'm not totally confident in these changes. They warrant much more testing. This logic is very, very confusing.

* Per #1761, call compute_percentile() when double-checking the percentile values.

* Per #1761, remove unused variable.

* Per #1761, add warning for percentiles > 100.

* Per #1761. In set_perc(), after testing cleaned up code. SL

* Per issue #1761: adding new config file for testing dynamic FBIAS values. SL

* Per issue #1761: added new unit test for dynamic FBIAS values when running grid_stat. SL

* Per issue #1761, modified FBIAS section to indicated that the user can use dynamic values that are not 1.0. SL

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update met/docs/Users_Guide/config_options.rst

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <johnhg@ucar.edu>

* Update test/config/GridStatConfig_fbias_perc_thresh

Co-authored-by: johnhg <johnhg@ucar.edu>

* Per issue #1761, set nc_pairs_flag = FALSE. SL

Co-authored-by: Seth Linden <linden@kiowa.rap.ucar.edu>
Co-authored-by: John Halley Gotway <johnhg@ucar.edu>
Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com>
…ing the logic for computing the ensemble range back to what it was previously. The new version produced very slight differences in the 6-th or 7-th decimal place when compared to previous results. There's not good reason for these changes which were caused by the order of operations in casting from doubles to floats. Reverting back to the old logic prevents diffs for anyone else downstream and is the prudent choice.
* #1949 Added CF compliant NetCDF into data IO

* #1949 Added commas

* #1948 Some corrections for typo and added the links for CF attributes

* #1948 Added Performance with NetCDF input data

* #1949 Corrected tyoe and applied Juloie's suggestions

Co-authored-by: Howard Soh <hsoh@kiowa.rap.ucar.edu>
…OSS. The intel compiler does not allow adjacent >> characters when defining maps.
@JohnHalleyGotway JohnHalleyGotway merged commit fa61672 into develop-ref Dec 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment