Fix installation instructions in User's Guide #1067

georgemccabe · 2021-08-05T18:37:47Z

Describe the Problem

The current installation instructions tell users to use the scripts in the build_components directory to install MET and other METplus components:

https://metplus.readthedocs.io/en/v4.0.0/Users_Guide/installation.html#build-components-and-using-manage-externals

However, the script does not work and produces many errors. There will be a separate issue to fix the scripts, but in the meantime we should update the documentation to direct users to download the latest release tarfile and refer to the installation instructions in chapter 2 of the MET User's Guide instead of using these scripts.

These changes should be applied to the main_v4.0 and develop branches.

A recent GitHub Discussions question brought this to attention: #1059

The comments of this discussion include info provided to the user to get MET installed that can be used as a reference to update the documentation.

Relevant Deadlines

ASAP

Funding Source

Define the source of funding and account keys here or state NONE.

Define the Metadata

Assignee

Select engineer(s) or no engineer required
Select scientist(s) or no scientist required

Labels

Select component(s)
Select priority
Select requestor(s)

Projects and Milestone

Select Organization level Project for support of the current coordinated release
Select Repository level Project for development toward the next official release or add alert: NEED PROJECT ASSIGNMENT label
Select Milestone as the next bugfix version

Define Related Issue(s)

Consider the impact to the other METplus components.

METplus, MET, METdatadb, METviewer, METexpress, METcalcpy, METplotpy

Bugfix Checklist

See the METplus Workflow for details.

The text was updated successfully, but these errors were encountered:

hankenstein2 · 2021-08-24T14:56:19Z

One line change in installation.rst. Pushed to develop and main_v4.0

jprestop · 2021-09-09T19:26:55Z

@fisherhucar
This issue was closed, but it is still confusing users (Discussion #1149). It does not appear that documentation was added to direct users to download the latest release tarfile and refer to the installation instructions in chapter 2 of the MET User's Guide instead of using these scripts. Given the continued confusion and problems with manage_externals, it seems we should potentially remove the “Build_components and using manage_externals” section entirely (adding it back once it's ready for use) in favor of the directing users to download the latest release tarfile and referring the users to the installation instructions in chapter 2 of the MET User's Guide instead as the issue describes. When you're ready for a pull request, feel free to assign it to me or @georgemccabe. Thanks!

…n to point to installation instructions for MET

jprestop · 2021-09-14T19:50:20Z

@fisherhucar
@georgemccabe and I had some time to work on this today, so this work is now complete. I'll submit a pull request now for develop and main.

* Per #1067, modified installation instructions and system configuration to point to installation instructions for MET * removed RTD python package requirements since they are already installed by RTD - fixes issue where bulleted lists bullets disappeared Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com>

…ame term

* removed -ref from end of branch name when looking for new input data on web server so develop-ref can check for new develop data * feature 779 add support for output_flag, nc_pairs_flag, and climo_cdf dictionaries in GridStat (#858) * Feature 779 compare pdf (#860) * Feature 857 tc stat met config (2nd attempt) (#862) * remove quotes around branch items * only build docs in GHA * added missing jobs item * cd back to GITHUB_WORKSPACE * cd back to github workspace * removed html theme options needed for version selector that are no longer used * moved documentation building into script, use sphinx_rtd_theme from pip instead of custom version, added info to contrib guide about CI * rename jobs and steps * Feature 767 ext dependencies doc update (#866) Co-authored-by: George McCabe <mccabe@ucar.edu> * feature CI documentation (#867) * Feature 836 rtd release doc (#870) * Added section for ReadTheDocs, added basic info about the Release Guide and Verification Datasets Guide, but more information on those needs to be added later * Added information about the various versions available in the documentation * Updated the ReadTheDocs section with information on hidden branches and how to access them; Modified dtcenter.github.io references * Added section to add_use_case.rst about Accessing the Documentation and modified documentation.rst to indicate the docs can still be built manually * Modified format of list * Modified formatting * Changed GitHub Pages links to Read the Docs links * Modified formatting * Fixed typo * Updated Release Guide for Read The Docs * Took out duplicate data and consolidated sections * Update docs/Contributors_Guide/add_use_case.rst Removed sentence Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Fixed typo Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Removed end of previously removed sentence. Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Adding NOAA/CPC to the list of requestors. Already ran the script to push this change to all the METplus repos. * Adding common label for NOAA/OPC. The new label has already been pushed to all the METplus-related repos. * sort list of files in directory to ensure the same result regardless of OS * Feature 852 series by same name (#868) * feature 871 TCGen new MET config variables (#872) * Feature 728 update python embedding (#876) Co-authored-by: George McCabe <mccabe@ucar.edu> * Feature 629 metdbload (#882) Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> * feature_630_UIUC_GDF_TDF (#878) Co-authored-by: George McCabe <mccabe@ucar.edu> * moved new use case into another group * Update MODE_fcstFV3_obsGOES_BrightnessTempObjs.py * feature 880 improve field info handling (#881) * Feature 686 hdr tdr (#885) Co-authored-by: George McCabe <mccabe@ucar.edu> * removed NEW from newly added use case * feature 768 fix broken climo stdev (#886) * Switched order of instructions to merge release branch and updating release notes. Updating release notes should occur before merging the release branch. * Feature 551 create pdf user guide (#890) * Test latex_* settings in conf.py * Test latex_* settings in conf.py * Formatting in rst files for PDF * Formatting in rst files for PDF * Formatting in rst files for PDF * Test rst file change for PDF formatting * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Test TOC settings * Test TOC settings * Test TOC settings * Test reference section * Test reference section * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Remove local pdf build lines * Test quick search mods for PDF * Test quick search mods for PDF * Update quicksearch.rst Format HTML and PDF separately * Update quicksearch.rst Fix typo in "only" directive * Update quicksearch.rst Fix typos in latex formatting * Fix typo in quicksearch.rst * Update systemconfiguration.rst * Update conf.py Address: WARNING: The config value `latex_show_pagerefs' has type `str', defaults to `bool'. * Update conf.py Fix typo, change master_doc variable to address warning * Update conf.py * Update conf.py * Update conf.py * Update conf.py Test changing the root doc for PDF * Update conf.py Change latex_master_doc back to Users Guide Co-authored-by: Keith Searight <searight@ucar.edu> * Feature 779 add support for MODE and PointStat configs (#888) * removed duplicate entry in glossary * changed string to boolean to remove warning * Added identifier to quicksearch.rst ci-docs-only * Feature 779 pb2nc configs (#893) * Feature 779 grid stat configs and climo_mean/stdev (#894) * Changes to release guide steps for MET. Recommend making silimar changes for the other repos. For each release type, after the checkout_[develop|main]_branch.rst step, add a call to the new create_release_feature_branch.rst release step. * Adding create_release_feature_branch.rst to all the release steps for METcalcpy, METplotpy, METdatadb, METviewer, and METexpress. * Added argument to code-blocks * Added release guide for METexpress development releases. * Delete Regrid_PCP_obsERA_obsOnly_Blocking_orig.conf Old configuration file * Feature 626 hovmoeller diagram (#889) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 627 coherence spectra (#891) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * create 4.0.0-beta5 release (#897) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Update pull_request_template.md Added entry for completion date for pull request review. * feature 900 single metplus_config.conf file (#901) * update version for development towards rc1 * Feature authorship (#912) * Add a direct link for the user's guide citation and then link to it from the top-level list of authors. * Add a release_steps/rotate_authorship.rst step and update the official release instructions for MET, METcalcpy, METplotpy, and METplus. The other repos do not include a complete set of release instructions yet. * Change top-level authorship list to alphabetical order. * Define author_list in docs/conf.py and reference it in the citation. * Adding author_list to the variables to be exported. * Use CIRA and IMSG instead of CIR and IM, respectively. * do not run documentation workflow on develop-ref branch, only run step to upload warnings artifact if there was a failure * test sending slack message when a release is published * tabs to spaces * fixed multi line command * removed old Travis-CI content * clean docs, READMEs, and CI for release * changed badge for testing workflow to display status of default branch instead of specific branch so users don't see accidental breaks in develop branch and we don't need to update it for each release * fixed path to version file in docker hook helper script * updated manage externals stable config and created symbolic link to Externals.cfg to avoid duplicate information * updated METplus release instructions to isolate release specific changes to release branch to avoid having to change develop branch back to original content * ci-run-diff * run all use cases if push to develop or main_v* branches to ensure nothing breaks! * run ALL use cases if push to develop on main_v* * cast PosixPath to string to prevent crash when using Python 3.8.10 * feature 681 Modifed wording of regrid dictionary references (#916) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> * bugfix 914 handle complex _VAR<n>_OPTIONS like MET dictionaries (#915) * added test to recreate error, then fix it * ci-run-diff * Feature 673 metviewer release (#910) Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> * Updated directions per Tara's instructions. * Added update_dtc_website.rst to metcalcpy and metplotpy subdirectories * .. include:: release_steps/met/update_dtc_website.rst * Corrected subdirectories from met to metcalcpy and metplotpy as needed * Feature 903 update users guide (#919) Co-authored-by: John Halley Gotway <johnhg@ucar.edu> * Fixes to automation to handle main_vX.Y branches (#920) * update version to show development towards 4.1.0-beta1 * changes made to main_v4.0 as bugfix to get docker data build to stop reporting a failure * generate union of sample data with subset to force a successful build to remove failed check * Added release guide for METexpress production releases. * Added announcement section to release guide for METexpress production releases. * Added rotate author section to release guide for METexpress production releases. * Fixed length of title underlines for METexpress release guide. * added useful logging messages to script that builds documentation so it is clear why it fails or if is succeeds * Added new alert: REQUIRED FOR RELEASE label to all the METplus repos. * modified steps for METplus to include updating release date and creating -ref branch to generate truth data for testing * Added more content to METdatadb release guides, following model of METcalcpy (#927) * added script to run on DTCenter web server to create a new input data directory for the next upcoming release and create symbolic links to the correct files from previous releases * feature 928 PCPCombine option to skip lookback in derive mode (#930) * Edits to METexpress release guide * feature 924 support extra options in RegridDataPlane (#929) * fixed minor bug in usage wrapper * strip off whitespace from version numbers so they are read correctly when installing as a package * Migrate issue and PR template changes from PR MET/#1803 into METplus develop branch. * Update README.md Adding GitHub Discussions info * changed non-unicode apostrophe and fixed typo in URL * feature 749 TCPairs refactor (#937) * removed file that should have been deleted in merge * Probability field threshold control in SeriesAnalysis (#942) * Somehow the required labels weren't present. Adding 2 required: labels as well as one for requestor: NASA/other. * feature 960 GenVxMask -type (#961) * feature 926 TCMPRPlotter improvements (#959) * changed variable name so that it does not overwrite author variable used in copyright * add missing quick search items (#962) * run pip freeze before use case commands to see python environment used to run in the logs * Feature 933 cartopy hpc (#964) * Modification to use NaturalEarth shapefiles that are already downloaded and saved to file in location designated by the CARTOPY_DIR environment. * Github Issue #933 Check for CARTOPY_DIR first, if unset, then proceed as before. * updated documentation for offline systems * Updated docs based on feedback Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> * Updated thumbnail path * Feature 963 quick search (#965) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 839 conda envs in automation (#967) * feature 641 MTD input to ExtractTiles (#968) Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu> * fixed documentation typos from bad merge * Feature 834 use case ice cover (#970) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * doc updates (#972) * fixed timing logs to show MM:SS instead of HH:MM * fixed typo in doc * feature 936 force MET version used for testing (#977) * moved logic for creating conda environments for metplus base and py_embed base to a script so it can be called on a local machine to create these environments * moved logic to update conda to docker file because update cannot be done on conda for a shared version * updated instructions to include steps to create conda environments on a local machine * Feature 963 quick search (#981) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo * Per #963, removed replace directive since it is not being used * Per #963, testing change to Note section for keywords * Per #963, Testing return in note * Per #963, removed note section under keywords and moved down the png name. * Per #963, trying out various formatting options * Per #963, trying out various formatting options * Per #963, added additional keywords headers to get a better feel for what it would actually look like * Added numbers to keywords for easier referencing * Per #963, cleaned up examples and left with the formatting the team chose * Per #963, try out adding a code block around a sphinx_gallery_thumbnail_path to see if it disappears because remove_config_comments was already set to True in the conf.py file, but this only removes configuration comments from code blocks, not from text blocks. * Per #963, trying an additonal comment to eliminate sphinx_gallery_thumbnail_path * Per #963, removing additonal comment to eliminate sphinx_gallery_thumbnail_path because it got rid of the thumbnail image * Per #963, adding py to code-block to see if it eliminates sphinx_gallery_thumbnail_path * Per #963, removing the code-block because it does not get rid of sphinx_gallery_thumbnail_path * first attempt at note update without web links * updating keywords area * updating keywords area * updating keywords area * adding quick search link * fixing quick search link * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * deleting empty spaces * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * Changed ASCII2NC to ASCII2NCToolUseCase * Modified list of keywords * Fixed typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 956 develop discussions (#988) * Per 1833, changing met_help references to Discussions * Per #1833, changed references to met_help@ucar.edu to Discussions and updated a couple of other links. * Per #956, Fixed typo * Per #956, fixed section referring to Known Issues as suggested by John HG. * Per #956, removed met_help@ucar.edu reference. Checked to ensure author_email was not being used. * feature 986 TCPairs valid time (#997) * feature 986 TCPairs allow run all times when LOOP_ORDER = processes (#1013) * Feature 1002 user script files (#1014) * Update Blocking.py Added some comments * Update Blocking.py * Added mpr output * Added MPR output * Updated documentation * Fixed a path * Updates to documentation * call script to populate file list, output file list to output directory instead of under input base * added env file so pytests can run easily on seneca * improved logging readability * moved functions up to parent class so they can be used by UserScript * updated logic to match change to subset_input_files function return value * in run_at_time function loop over custom list and get files for the current run time before running since this function is called only if LOOP_BY=times and does not call the function that handles this -- consider refactoring to move logic for CUSTOM_LOOP_LIST so that it is handled consistently across all wrappers instead of being handled inside each * updated logic for UserScript to use the input dir/template variables to mimic logic in GridDiag to populate a list of files that are relevant for each run time of the use case * always return True from get_all_files for UserScript because handling file lists is optional * modified examples to call a script that checks environment variables and prints out the contents of file lists if they are set -- this better demonstrates how to use UserScript and how to get lists of files into a user's script, ci-run-diff * don't loop to find files if time info is not set * rerun use case that failed * trigger other failing use cases to run * changed name of config variable because name is now a reserved config variable * skip use cases that are no longer failing * Fixed a typo * add skip times logic to function that finds all files to process * added logic to put 'missing' for files that are not found for a given run time (for UserScript) * added an extra lead time to example to demonstrate handling of missing files * added logic to specify label for each input template file list, changed env var from METPLUS_<label> to METPLUS_FILELIST_<label>, changed user script example to find all keys that start with METPLUS_FILELIST_ to print * added a label to demonstrate functionality * added new config variables, ci-run-diff * added documentation for new functionality for UserScript wrapper to find file paths * Updated to use USER_SCRIPT text files * Fixed typo * Cleanup to .conf file * Cleanup to UserScript_obsERA_obsOnly_Blocking.conf * Updates to use the new file listing for UserScript * Cleanup to old python programs * Fixed a typo * change branch for METplotpy to feature branch to test changes * change METplotpy branch to develop since required change was merged into its develop branch * changed use cases back to new = false so they don't run every workflow Co-authored-by: Christina Kalb <kalb@ucar.edu> * Feature 615 gfdl tc tracking (#1020) Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> * fixed incorrect length of overline * error out if ouput data volumes fail to update * don't fail if no volumes to build * added error checking to script that updates docker data volumes that contain output truth data * skip diff for binary index files created from GFDL tracker * Feature 950 weather regime freq (#1024) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 952 blocking files (#1023) * Added output MPR file for Blocking * Cleanup and edits to creating mpr output * Fixed a typo * Added mpr output * Fixed a typo * Updated to use environment vars * Updates to blocking documentation * Delete conf file that was accidentally checked in * removed unused scripts Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 892 rmm omi drivers (#1028) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Changes for 4.1.0-beta1 release (#1027) * changed version for beta1 release * added release notes for 4.1.0-beta1 * removed unnecessary arguments to run_metplus.py * removed release notes item that is pushed to next beta * added line breaks between sections * added OMI and RMM use cases * update version to dev 4.1.0-beta2 * support skip times in example wrapper * Feature 759 fr met py (#1025) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated list of use cases to run in tests to reflect use case that was removed * remove log for copying files and modify log output for difference summary so it is easier to find * bugfix 1021 develop climo mean/stdev field (#1039) * fixed remove_quotes logic for handling config lists to only remove quotes around each value, not every quotation mark found -- changed logic for reading climo field to remove quotes around item to properly set dictionary items, ci-run-diff * fixed unit tests to reflect actual values to set for climo field * save script to update use case data directories on DTC web server * move step to update version number in develop branch right after creating release to minimize time that development will be done with the incorrect version number * removed step that is no longer needed after #963 * added step to set up next release data directory on DTC web server * updated wording to be more clear * Release Guide updates (#1041) * added newline after each difference summary item for better readability * use relative path for image * added content from the GitHub wiki so I could remove the wiki pages * feature 931 default wrapped MET config file (#1037) * updated info for _CONFIG_FILE variables in glossary * Feature 892 rmm omi tests (#1038) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> * feature 951 add support for setting hss_ec_value (#1048) * Fix stale URL in GitHub issue and pull request templates. * changed import to prevent error if location of variable changes when the util directory is refactored * report error and exit if default metplus config files were somehow removed to prevent confusing errors that will result * updated error message to list parm directory where default confs are searched to help debugging * suggest that METPLUS_PARM_BASE may be the cause of the error * Added note to update information in conf.py file for release * updated link to instructions to upload data via FTP * feature 1057 pass directory to tcmpr plot script (#1085) * Feature 935 release guide (#1098) * Per #935, made updates to Release Guide * Per #935, made updates to Release Guide Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Changed component installation instructions to download MET as a tar file * changed key in use case group list from 'new' to 'run' to be more clear * Added lines to only build documentation for pull requests where only documentation changes have been made * Added quotes to echo on line 21 * Feature 874 doc (#1115) * Per #874, added information for the Release Guide and Verification Dataset Guide * Per #874, change to fix Unexpected indentation warning. * Added lines to only build documentation for pull requests where only documentation changes have been made Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Update task.md Testing addition of new default labels * Update task.md Fixing syntax issue with addition of new default labels * Update task.md Reverting to original text before changes made for addition of labels. * Added additional default labels * Feature 1062 pcp combine level template (#1118) * feature 1069 TCPairs write_valid, valid_inc, valid_exc (#1122) * Feature 1103 PointStat orank output_flag (#1124) * per comment in #1124, changed order of output flags to group related flags * Feature 617 gfdl etc (#1121) * added new use cases to existing use case group * Feature 1001 blocking statanalysis (#1125) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated instructions for updating the truth dataset reference branch * feature_1128_v4.1.0-beta2 (#1129) * update version for development towards next beta release * updated release guide instructions * update instructions to remove references to NCAR/METplus * Feature release guide (#1132) * Moved create_release_extra.rst into the release_steps area as all components except for METplus use the same file; Added instructions to update_dtc_website.rst * Removed text that was not supposed to be there. * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Removed specific versions of update_dtc_website since they did not differ from the version in release_steps * Added variable - otherWebsiteUpdates - and its value. Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: johnhg <johnhg@ucar.edu> * changed to use PRMSL instead of MSLET for mean sea level pressure * Committing directly to develop for a minor documentation change. Add a release note step about formatting major/important changes in bold. * feature 1067 develop install instruct (#1156) * Per #1067, modified installation instructions and system configuration to point to installation instructions for MET * removed RTD python package requirements since they are already installed by RTD - fixes issue where bulleted lists bullets disappeared Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Removing version number from sphinx-gallery and adding one line to the update_release_notes files * feature 1147 final conf sorting (#1152) * removed config variable that is no longer used/needed * cleaned up functions that handle setting CURRENT_[FCST/OBS]_[NAME/LEVEL] * clean up * expand path of config argument to run_metplus.py for easier debugging * removed redundant logic and added comments * cleanup * added logic to move config variables that are runtime specific to a [runtime] section in the final conf that is written after the run completes * changed how config arguments are read so that order that arguments are found is preserved instead of setting explicit overrides at the end * minor change to trigger build, ci-run-all-cases * rearranged logic to save list of config inputs with full paths for easier debugging * move all config vars that start with LOG or end with BASE to runtime section * remove vars that start with CURRENT from final conf * removed confusing logic allowing override of parm base and cleaned up logging to be easier to read/understand * added METPLUS_PARM_BASE env var logic back * added old vs. new default value mismatch info for pb_report_type in PB2NC config file * renamed config var name * use PARM_BASE instead of METPLUS_BASE/parm since it will still be set * use develop version of METviewer docker image (may need to make this configurable in testing.yml in the future) * run cyclone plotter use case to test that new conda environment in docker image now contains missing cartopy map files * added dockerfile to copy cartopy shape files into run image if cartopy is listed as dependencies * download script used to download cartopy shape files and run it * added copy of conda environment * added logic to download cartopy shape files for metplotpy environment * added cartopy dependency to use cases so the shapefiles are copied into run environment * trigger 1 use case that uses metplotpy_env to test cartopy shapefiles are found properly * added instructions to create weatherregime environment that was missing * cleaned up list of packages used * removed extra use case group used for testing * removed netcdf package from env because it is already installed and version number was causing a conflict * added cartopy shapefile copy to use case that needs it * download cartopy shape files for weatherregime python environment because files were not found from base env (metplotpy) * removed debug message that fills up log files with info that is not very useful * updated input directories to use _WeatherRegime directory instead of _Blocking * updated location of input data that was not found in UserScript_fcstGFS_obsERA_WeatherRegime * updated readme with info on how to install metplotpy/metcalcpy in conda environments * added 3rd group of cartopy shapefiles to download because they are used in weatherregime use cases * try using cartopy download script from forked repo that has missing shapefile zip file added * updated input paths to match new data locations * use master branch of SciTools/cartopy since pull request was merged Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: John Halley Gotway <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> Co-authored-by: Dan Adriaansen <dadriaan@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: mrinalbiswas <biswas@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: Keith Searight <keith.searight@noaa.gov> Co-authored-by: Keith Searight <searight@ucar.edu> Co-authored-by: Molly Smith <molly.b.smith@noaa.gov> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: Tatiana Burek <tatiana@ucar.edu> Co-authored-by: Venita Hagerty <38571614+venitahagerty@users.noreply.github.com> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: George McCabe <mccabe@seneca.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu>

* removed -ref from end of branch name when looking for new input data on web server so develop-ref can check for new develop data * feature 779 add support for output_flag, nc_pairs_flag, and climo_cdf dictionaries in GridStat (#858) * Feature 779 compare pdf (#860) * Feature 857 tc stat met config (2nd attempt) (#862) * remove quotes around branch items * only build docs in GHA * added missing jobs item * cd back to GITHUB_WORKSPACE * cd back to github workspace * removed html theme options needed for version selector that are no longer used * moved documentation building into script, use sphinx_rtd_theme from pip instead of custom version, added info to contrib guide about CI * rename jobs and steps * Feature 767 ext dependencies doc update (#866) Co-authored-by: George McCabe <mccabe@ucar.edu> * feature CI documentation (#867) * Feature 836 rtd release doc (#870) * Added section for ReadTheDocs, added basic info about the Release Guide and Verification Datasets Guide, but more information on those needs to be added later * Added information about the various versions available in the documentation * Updated the ReadTheDocs section with information on hidden branches and how to access them; Modified dtcenter.github.io references * Added section to add_use_case.rst about Accessing the Documentation and modified documentation.rst to indicate the docs can still be built manually * Modified format of list * Modified formatting * Changed GitHub Pages links to Read the Docs links * Modified formatting * Fixed typo * Updated Release Guide for Read The Docs * Took out duplicate data and consolidated sections * Update docs/Contributors_Guide/add_use_case.rst Removed sentence Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Fixed typo Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Removed end of previously removed sentence. Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Adding NOAA/CPC to the list of requestors. Already ran the script to push this change to all the METplus repos. * Adding common label for NOAA/OPC. The new label has already been pushed to all the METplus-related repos. * sort list of files in directory to ensure the same result regardless of OS * Feature 852 series by same name (#868) * feature 871 TCGen new MET config variables (#872) * Feature 728 update python embedding (#876) Co-authored-by: George McCabe <mccabe@ucar.edu> * Feature 629 metdbload (#882) Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> * feature_630_UIUC_GDF_TDF (#878) Co-authored-by: George McCabe <mccabe@ucar.edu> * moved new use case into another group * Update MODE_fcstFV3_obsGOES_BrightnessTempObjs.py * feature 880 improve field info handling (#881) * Feature 686 hdr tdr (#885) Co-authored-by: George McCabe <mccabe@ucar.edu> * removed NEW from newly added use case * feature 768 fix broken climo stdev (#886) * Switched order of instructions to merge release branch and updating release notes. Updating release notes should occur before merging the release branch. * Feature 551 create pdf user guide (#890) * Test latex_* settings in conf.py * Test latex_* settings in conf.py * Formatting in rst files for PDF * Formatting in rst files for PDF * Formatting in rst files for PDF * Test rst file change for PDF formatting * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Test TOC settings * Test TOC settings * Test TOC settings * Test reference section * Test reference section * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Remove local pdf build lines * Test quick search mods for PDF * Test quick search mods for PDF * Update quicksearch.rst Format HTML and PDF separately * Update quicksearch.rst Fix typo in "only" directive * Update quicksearch.rst Fix typos in latex formatting * Fix typo in quicksearch.rst * Update systemconfiguration.rst * Update conf.py Address: WARNING: The config value `latex_show_pagerefs' has type `str', defaults to `bool'. * Update conf.py Fix typo, change master_doc variable to address warning * Update conf.py * Update conf.py * Update conf.py * Update conf.py Test changing the root doc for PDF * Update conf.py Change latex_master_doc back to Users Guide Co-authored-by: Keith Searight <searight@ucar.edu> * Feature 779 add support for MODE and PointStat configs (#888) * removed duplicate entry in glossary * changed string to boolean to remove warning * Added identifier to quicksearch.rst ci-docs-only * Feature 779 pb2nc configs (#893) * Feature 779 grid stat configs and climo_mean/stdev (#894) * Changes to release guide steps for MET. Recommend making silimar changes for the other repos. For each release type, after the checkout_[develop|main]_branch.rst step, add a call to the new create_release_feature_branch.rst release step. * Adding create_release_feature_branch.rst to all the release steps for METcalcpy, METplotpy, METdatadb, METviewer, and METexpress. * Added argument to code-blocks * Added release guide for METexpress development releases. * Delete Regrid_PCP_obsERA_obsOnly_Blocking_orig.conf Old configuration file * Feature 626 hovmoeller diagram (#889) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 627 coherence spectra (#891) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * create 4.0.0-beta5 release (#897) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Update pull_request_template.md Added entry for completion date for pull request review. * feature 900 single metplus_config.conf file (#901) * update version for development towards rc1 * Feature authorship (#912) * Add a direct link for the user's guide citation and then link to it from the top-level list of authors. * Add a release_steps/rotate_authorship.rst step and update the official release instructions for MET, METcalcpy, METplotpy, and METplus. The other repos do not include a complete set of release instructions yet. * Change top-level authorship list to alphabetical order. * Define author_list in docs/conf.py and reference it in the citation. * Adding author_list to the variables to be exported. * Use CIRA and IMSG instead of CIR and IM, respectively. * do not run documentation workflow on develop-ref branch, only run step to upload warnings artifact if there was a failure * test sending slack message when a release is published * tabs to spaces * fixed multi line command * removed old Travis-CI content * clean docs, READMEs, and CI for release * changed badge for testing workflow to display status of default branch instead of specific branch so users don't see accidental breaks in develop branch and we don't need to update it for each release * fixed path to version file in docker hook helper script * updated manage externals stable config and created symbolic link to Externals.cfg to avoid duplicate information * updated METplus release instructions to isolate release specific changes to release branch to avoid having to change develop branch back to original content * ci-run-diff * run all use cases if push to develop or main_v* branches to ensure nothing breaks! * run ALL use cases if push to develop on main_v* * cast PosixPath to string to prevent crash when using Python 3.8.10 * feature 681 Modifed wording of regrid dictionary references (#916) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> * bugfix 914 handle complex _VAR<n>_OPTIONS like MET dictionaries (#915) * added test to recreate error, then fix it * ci-run-diff * Feature 673 metviewer release (#910) Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> * Updated directions per Tara's instructions. * Added update_dtc_website.rst to metcalcpy and metplotpy subdirectories * .. include:: release_steps/met/update_dtc_website.rst * Corrected subdirectories from met to metcalcpy and metplotpy as needed * Feature 903 update users guide (#919) Co-authored-by: John Halley Gotway <johnhg@ucar.edu> * Fixes to automation to handle main_vX.Y branches (#920) * update version to show development towards 4.1.0-beta1 * changes made to main_v4.0 as bugfix to get docker data build to stop reporting a failure * generate union of sample data with subset to force a successful build to remove failed check * Added release guide for METexpress production releases. * Added announcement section to release guide for METexpress production releases. * Added rotate author section to release guide for METexpress production releases. * Fixed length of title underlines for METexpress release guide. * added useful logging messages to script that builds documentation so it is clear why it fails or if is succeeds * Added new alert: REQUIRED FOR RELEASE label to all the METplus repos. * modified steps for METplus to include updating release date and creating -ref branch to generate truth data for testing * Added more content to METdatadb release guides, following model of METcalcpy (#927) * added script to run on DTCenter web server to create a new input data directory for the next upcoming release and create symbolic links to the correct files from previous releases * feature 928 PCPCombine option to skip lookback in derive mode (#930) * Edits to METexpress release guide * feature 924 support extra options in RegridDataPlane (#929) * fixed minor bug in usage wrapper * strip off whitespace from version numbers so they are read correctly when installing as a package * Migrate issue and PR template changes from PR MET/#1803 into METplus develop branch. * Update README.md Adding GitHub Discussions info * changed non-unicode apostrophe and fixed typo in URL * feature 749 TCPairs refactor (#937) * removed file that should have been deleted in merge * Probability field threshold control in SeriesAnalysis (#942) * Somehow the required labels weren't present. Adding 2 required: labels as well as one for requestor: NASA/other. * feature 960 GenVxMask -type (#961) * feature 926 TCMPRPlotter improvements (#959) * changed variable name so that it does not overwrite author variable used in copyright * add missing quick search items (#962) * run pip freeze before use case commands to see python environment used to run in the logs * Feature 933 cartopy hpc (#964) * Modification to use NaturalEarth shapefiles that are already downloaded and saved to file in location designated by the CARTOPY_DIR environment. * Github Issue #933 Check for CARTOPY_DIR first, if unset, then proceed as before. * updated documentation for offline systems * Updated docs based on feedback Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> * Updated thumbnail path * Feature 963 quick search (#965) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 839 conda envs in automation (#967) * feature 641 MTD input to ExtractTiles (#968) Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu> * fixed documentation typos from bad merge * Feature 834 use case ice cover (#970) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * doc updates (#972) * fixed timing logs to show MM:SS instead of HH:MM * fixed typo in doc * feature 936 force MET version used for testing (#977) * moved logic for creating conda environments for metplus base and py_embed base to a script so it can be called on a local machine to create these environments * moved logic to update conda to docker file because update cannot be done on conda for a shared version * updated instructions to include steps to create conda environments on a local machine * Feature 963 quick search (#981) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo * Per #963, removed replace directive since it is not being used * Per #963, testing change to Note section for keywords * Per #963, Testing return in note * Per #963, removed note section under keywords and moved down the png name. * Per #963, trying out various formatting options * Per #963, trying out various formatting options * Per #963, added additional keywords headers to get a better feel for what it would actually look like * Added numbers to keywords for easier referencing * Per #963, cleaned up examples and left with the formatting the team chose * Per #963, try out adding a code block around a sphinx_gallery_thumbnail_path to see if it disappears because remove_config_comments was already set to True in the conf.py file, but this only removes configuration comments from code blocks, not from text blocks. * Per #963, trying an additonal comment to eliminate sphinx_gallery_thumbnail_path * Per #963, removing additonal comment to eliminate sphinx_gallery_thumbnail_path because it got rid of the thumbnail image * Per #963, adding py to code-block to see if it eliminates sphinx_gallery_thumbnail_path * Per #963, removing the code-block because it does not get rid of sphinx_gallery_thumbnail_path * first attempt at note update without web links * updating keywords area * updating keywords area * updating keywords area * adding quick search link * fixing quick search link * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * deleting empty spaces * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * Changed ASCII2NC to ASCII2NCToolUseCase * Modified list of keywords * Fixed typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 956 develop discussions (#988) * Per 1833, changing met_help references to Discussions * Per #1833, changed references to met_help@ucar.edu to Discussions and updated a couple of other links. * Per #956, Fixed typo * Per #956, fixed section referring to Known Issues as suggested by John HG. * Per #956, removed met_help@ucar.edu reference. Checked to ensure author_email was not being used. * feature 986 TCPairs valid time (#997) * feature 986 TCPairs allow run all times when LOOP_ORDER = processes (#1013) * Feature 1002 user script files (#1014) * Update Blocking.py Added some comments * Update Blocking.py * Added mpr output * Added MPR output * Updated documentation * Fixed a path * Updates to documentation * call script to populate file list, output file list to output directory instead of under input base * added env file so pytests can run easily on seneca * improved logging readability * moved functions up to parent class so they can be used by UserScript * updated logic to match change to subset_input_files function return value * in run_at_time function loop over custom list and get files for the current run time before running since this function is called only if LOOP_BY=times and does not call the function that handles this -- consider refactoring to move logic for CUSTOM_LOOP_LIST so that it is handled consistently across all wrappers instead of being handled inside each * updated logic for UserScript to use the input dir/template variables to mimic logic in GridDiag to populate a list of files that are relevant for each run time of the use case * always return True from get_all_files for UserScript because handling file lists is optional * modified examples to call a script that checks environment variables and prints out the contents of file lists if they are set -- this better demonstrates how to use UserScript and how to get lists of files into a user's script, ci-run-diff * don't loop to find files if time info is not set * rerun use case that failed * trigger other failing use cases to run * changed name of config variable because name is now a reserved config variable * skip use cases that are no longer failing * Fixed a typo * add skip times logic to function that finds all files to process * added logic to put 'missing' for files that are not found for a given run time (for UserScript) * added an extra lead time to example to demonstrate handling of missing files * added logic to specify label for each input template file list, changed env var from METPLUS_<label> to METPLUS_FILELIST_<label>, changed user script example to find all keys that start with METPLUS_FILELIST_ to print * added a label to demonstrate functionality * added new config variables, ci-run-diff * added documentation for new functionality for UserScript wrapper to find file paths * Updated to use USER_SCRIPT text files * Fixed typo * Cleanup to .conf file * Cleanup to UserScript_obsERA_obsOnly_Blocking.conf * Updates to use the new file listing for UserScript * Cleanup to old python programs * Fixed a typo * change branch for METplotpy to feature branch to test changes * change METplotpy branch to develop since required change was merged into its develop branch * changed use cases back to new = false so they don't run every workflow Co-authored-by: Christina Kalb <kalb@ucar.edu> * Feature 615 gfdl tc tracking (#1020) Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> * fixed incorrect length of overline * error out if ouput data volumes fail to update * don't fail if no volumes to build * added error checking to script that updates docker data volumes that contain output truth data * skip diff for binary index files created from GFDL tracker * Feature 950 weather regime freq (#1024) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 952 blocking files (#1023) * Added output MPR file for Blocking * Cleanup and edits to creating mpr output * Fixed a typo * Added mpr output * Fixed a typo * Updated to use environment vars * Updates to blocking documentation * Delete conf file that was accidentally checked in * removed unused scripts Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 892 rmm omi drivers (#1028) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Changes for 4.1.0-beta1 release (#1027) * changed version for beta1 release * added release notes for 4.1.0-beta1 * removed unnecessary arguments to run_metplus.py * removed release notes item that is pushed to next beta * added line breaks between sections * added OMI and RMM use cases * update version to dev 4.1.0-beta2 * support skip times in example wrapper * Feature 759 fr met py (#1025) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated list of use cases to run in tests to reflect use case that was removed * remove log for copying files and modify log output for difference summary so it is easier to find * bugfix 1021 develop climo mean/stdev field (#1039) * fixed remove_quotes logic for handling config lists to only remove quotes around each value, not every quotation mark found -- changed logic for reading climo field to remove quotes around item to properly set dictionary items, ci-run-diff * fixed unit tests to reflect actual values to set for climo field * save script to update use case data directories on DTC web server * move step to update version number in develop branch right after creating release to minimize time that development will be done with the incorrect version number * removed step that is no longer needed after #963 * added step to set up next release data directory on DTC web server * updated wording to be more clear * Release Guide updates (#1041) * added newline after each difference summary item for better readability * use relative path for image * added content from the GitHub wiki so I could remove the wiki pages * feature 931 default wrapped MET config file (#1037) * updated info for _CONFIG_FILE variables in glossary * Feature 892 rmm omi tests (#1038) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> * feature 951 add support for setting hss_ec_value (#1048) * Fix stale URL in GitHub issue and pull request templates. * changed import to prevent error if location of variable changes when the util directory is refactored * report error and exit if default metplus config files were somehow removed to prevent confusing errors that will result * updated error message to list parm directory where default confs are searched to help debugging * suggest that METPLUS_PARM_BASE may be the cause of the error * Added note to update information in conf.py file for release * updated link to instructions to upload data via FTP * feature 1057 pass directory to tcmpr plot script (#1085) * Feature 935 release guide (#1098) * Per #935, made updates to Release Guide * Per #935, made updates to Release Guide Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Changed component installation instructions to download MET as a tar file * changed key in use case group list from 'new' to 'run' to be more clear * Added lines to only build documentation for pull requests where only documentation changes have been made * Added quotes to echo on line 21 * Feature 874 doc (#1115) * Per #874, added information for the Release Guide and Verification Dataset Guide * Per #874, change to fix Unexpected indentation warning. * Added lines to only build documentation for pull requests where only documentation changes have been made Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Update task.md Testing addition of new default labels * Update task.md Fixing syntax issue with addition of new default labels * Update task.md Reverting to original text before changes made for addition of labels. * Added additional default labels * Feature 1062 pcp combine level template (#1118) * feature 1069 TCPairs write_valid, valid_inc, valid_exc (#1122) * Feature 1103 PointStat orank output_flag (#1124) * per comment in #1124, changed order of output flags to group related flags * Feature 617 gfdl etc (#1121) * added new use cases to existing use case group * Feature 1001 blocking statanalysis (#1125) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated instructions for updating the truth dataset reference branch * feature_1128_v4.1.0-beta2 (#1129) * update version for development towards next beta release * updated release guide instructions * update instructions to remove references to NCAR/METplus * Feature release guide (#1132) * Moved create_release_extra.rst into the release_steps area as all components except for METplus use the same file; Added instructions to update_dtc_website.rst * Removed text that was not supposed to be there. * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Removed specific versions of update_dtc_website since they did not differ from the version in release_steps * Added variable - otherWebsiteUpdates - and its value. Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: johnhg <johnhg@ucar.edu> * changed to use PRMSL instead of MSLET for mean sea level pressure * Committing directly to develop for a minor documentation change. Add a release note step about formatting major/important changes in bold. * feature 1067 develop install instruct (#1156) * Per #1067, modified installation instructions and system configuration to point to installation instructions for MET * removed RTD python package requirements since they are already installed by RTD - fixes issue where bulleted lists bullets disappeared Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Removing version number from sphinx-gallery and adding one line to the update_release_notes files * feature 1147 final conf sorting (#1152) * removed config variable that is no longer used/needed * cleaned up functions that handle setting CURRENT_[FCST/OBS]_[NAME/LEVEL] * clean up * expand path of config argument to run_metplus.py for easier debugging * removed redundant logic and added comments * cleanup * added logic to move config variables that are runtime specific to a [runtime] section in the final conf that is written after the run completes * changed how config arguments are read so that order that arguments are found is preserved instead of setting explicit overrides at the end * minor change to trigger build, ci-run-all-cases * rearranged logic to save list of config inputs with full paths for easier debugging * move all config vars that start with LOG or end with BASE to runtime section * remove vars that start with CURRENT from final conf * removed confusing logic allowing override of parm base and cleaned up logging to be easier to read/understand * added METPLUS_PARM_BASE env var logic back * added old vs. new default value mismatch info for pb_report_type in PB2NC config file * renamed config var name * use PARM_BASE instead of METPLUS_BASE/parm since it will still be set * use develop version of METviewer docker image (may need to make this configurable in testing.yml in the future) * run cyclone plotter use case to test that new conda environment in docker image now contains missing cartopy map files * added dockerfile to copy cartopy shape files into run image if cartopy is listed as dependencies * download script used to download cartopy shape files and run it * added copy of conda environment * added logic to download cartopy shape files for metplotpy environment * added cartopy dependency to use cases so the shapefiles are copied into run environment * trigger 1 use case that uses metplotpy_env to test cartopy shapefiles are found properly * added instructions to create weatherregime environment that was missing * cleaned up list of packages used * removed extra use case group used for testing * removed netcdf package from env because it is already installed and version number was causing a conflict * added cartopy shapefile copy to use case that needs it * download cartopy shape files for weatherregime python environment because files were not found from base env (metplotpy) * removed debug message that fills up log files with info that is not very useful * updated input directories to use _WeatherRegime directory instead of _Blocking * updated location of input data that was not found in UserScript_fcstGFS_obsERA_WeatherRegime * updated readme with info on how to install metplotpy/metcalcpy in conda environments * added 3rd group of cartopy shapefiles to download because they are used in weatherregime use cases * try using cartopy download script from forked repo that has missing shapefile zip file added * updated input paths to match new data locations * use master branch of SciTools/cartopy since pull request was merged * Feature 641 mtd feature relative (#1153) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1004 usecase ghrsst marine (#1182) * files for new use case * added new use case and mod files * upping verbosity for debug * more debugging * spelling fix * testing for climo issues * readded climo, changed python3 call in script * skip docker pull because docker create command will pull if needed, print full name of data volume used for easier debugging, no longer pass docker create command output to /dev/null because logic is no longer called from shell script (previously value was passed to script via std out so any logging info would be added to content) * moved new use case to its own section for testing * fixed typo * added PyEmbedIngest to process fcst/obs/climo data and read files into grid_stat to prevent out-of-memory errors * refactored script to try to reduce the amount of unnecessary memory the script uses * created config file to use PyEmbedIngest so use case can run as is on a machine with enough memory and run a modified version to work with the automated tests * removed use case from test suite because it uses more memory than the docker environment has available * removed old info * rearranged variables for readability, removed commented out variables Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Upload file for new use case * removed dependency on metplus function that is not needed * feature 1089 add distance_map to GridStat (#1190) * Feature 1187 name update (#1193) * updated file names for use case * updated documentation for renaming, changing data * Update docs/Contributors_Guide/add_use_case.rst * split section into 2 sections for clarity * added info about removing old data from sample input data, added info about conda environments used for running use cases and automated tests, added text to make instructions more clear if one of two commands should be run * added missing parenthesis Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: John Halley Gotway <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> Co-authored-by: Dan Adriaansen <dadriaan@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: mrinalbiswas <biswas@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: Keith Searight <keith.searight@noaa.gov> Co-authored-by: Keith Searight <searight@ucar.edu> Co-authored-by: Molly Smith <molly.b.smith@noaa.gov> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: Tatiana Burek <tatiana@ucar.edu> Co-authored-by: Venita Hagerty <38571614+venitahagerty@users.noreply.github.com> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: George McCabe <mccabe@seneca.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu>

* feature 779 add support for output_flag, nc_pairs_flag, and climo_cdf dictionaries in GridStat (#858) * Feature 779 compare pdf (#860) * Feature 857 tc stat met config (2nd attempt) (#862) * remove quotes around branch items * only build docs in GHA * added missing jobs item * cd back to GITHUB_WORKSPACE * cd back to github workspace * removed html theme options needed for version selector that are no longer used * moved documentation building into script, use sphinx_rtd_theme from pip instead of custom version, added info to contrib guide about CI * rename jobs and steps * Feature 767 ext dependencies doc update (#866) Co-authored-by: George McCabe <mccabe@ucar.edu> * feature CI documentation (#867) * Feature 836 rtd release doc (#870) * Added section for ReadTheDocs, added basic info about the Release Guide and Verification Datasets Guide, but more information on those needs to be added later * Added information about the various versions available in the documentation * Updated the ReadTheDocs section with information on hidden branches and how to access them; Modified dtcenter.github.io references * Added section to add_use_case.rst about Accessing the Documentation and modified documentation.rst to indicate the docs can still be built manually * Modified format of list * Modified formatting * Changed GitHub Pages links to Read the Docs links * Modified formatting * Fixed typo * Updated Release Guide for Read The Docs * Took out duplicate data and consolidated sections * Update docs/Contributors_Guide/add_use_case.rst Removed sentence Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Fixed typo Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/Contributors_Guide/add_use_case.rst Removed end of previously removed sentence. Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Adding NOAA/CPC to the list of requestors. Already ran the script to push this change to all the METplus repos. * Adding common label for NOAA/OPC. The new label has already been pushed to all the METplus-related repos. * sort list of files in directory to ensure the same result regardless of OS * Feature 852 series by same name (#868) * feature 871 TCGen new MET config variables (#872) * Feature 728 update python embedding (#876) Co-authored-by: George McCabe <mccabe@ucar.edu> * Feature 629 metdbload (#882) Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> * feature_630_UIUC_GDF_TDF (#878) Co-authored-by: George McCabe <mccabe@ucar.edu> * moved new use case into another group * Update MODE_fcstFV3_obsGOES_BrightnessTempObjs.py * feature 880 improve field info handling (#881) * Feature 686 hdr tdr (#885) Co-authored-by: George McCabe <mccabe@ucar.edu> * removed NEW from newly added use case * feature 768 fix broken climo stdev (#886) * Switched order of instructions to merge release branch and updating release notes. Updating release notes should occur before merging the release branch. * Feature 551 create pdf user guide (#890) * Test latex_* settings in conf.py * Test latex_* settings in conf.py * Formatting in rst files for PDF * Formatting in rst files for PDF * Formatting in rst files for PDF * Test rst file change for PDF formatting * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Change tocdepth to 3 * Change secnumdepth to 3 * Change secnumdepth/tocdepth to 4 * Test TOC settings * Test TOC settings * Test TOC settings * Test reference section * Test reference section * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Test quick search * Remove local pdf build lines * Test quick search mods for PDF * Test quick search mods for PDF * Update quicksearch.rst Format HTML and PDF separately * Update quicksearch.rst Fix typo in "only" directive * Update quicksearch.rst Fix typos in latex formatting * Fix typo in quicksearch.rst * Update systemconfiguration.rst * Update conf.py Address: WARNING: The config value `latex_show_pagerefs' has type `str', defaults to `bool'. * Update conf.py Fix typo, change master_doc variable to address warning * Update conf.py * Update conf.py * Update conf.py * Update conf.py Test changing the root doc for PDF * Update conf.py Change latex_master_doc back to Users Guide Co-authored-by: Keith Searight <searight@ucar.edu> * Feature 779 add support for MODE and PointStat configs (#888) * removed duplicate entry in glossary * changed string to boolean to remove warning * Added identifier to quicksearch.rst ci-docs-only * Feature 779 pb2nc configs (#893) * Feature 779 grid stat configs and climo_mean/stdev (#894) * Changes to release guide steps for MET. Recommend making silimar changes for the other repos. For each release type, after the checkout_[develop|main]_branch.rst step, add a call to the new create_release_feature_branch.rst release step. * Adding create_release_feature_branch.rst to all the release steps for METcalcpy, METplotpy, METdatadb, METviewer, and METexpress. * Added argument to code-blocks * Added release guide for METexpress development releases. * Delete Regrid_PCP_obsERA_obsOnly_Blocking_orig.conf Old configuration file * Feature 626 hovmoeller diagram (#889) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 627 coherence spectra (#891) Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * create 4.0.0-beta5 release (#897) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Update pull_request_template.md Added entry for completion date for pull request review. * feature 900 single metplus_config.conf file (#901) * update version for development towards rc1 * Feature authorship (#912) * Add a direct link for the user's guide citation and then link to it from the top-level list of authors. * Add a release_steps/rotate_authorship.rst step and update the official release instructions for MET, METcalcpy, METplotpy, and METplus. The other repos do not include a complete set of release instructions yet. * Change top-level authorship list to alphabetical order. * Define author_list in docs/conf.py and reference it in the citation. * Adding author_list to the variables to be exported. * Use CIRA and IMSG instead of CIR and IM, respectively. * do not run documentation workflow on develop-ref branch, only run step to upload warnings artifact if there was a failure * test sending slack message when a release is published * tabs to spaces * fixed multi line command * removed old Travis-CI content * clean docs, READMEs, and CI for release * changed badge for testing workflow to display status of default branch instead of specific branch so users don't see accidental breaks in develop branch and we don't need to update it for each release * fixed path to version file in docker hook helper script * updated manage externals stable config and created symbolic link to Externals.cfg to avoid duplicate information * updated METplus release instructions to isolate release specific changes to release branch to avoid having to change develop branch back to original content * ci-run-diff * run all use cases if push to develop or main_v* branches to ensure nothing breaks! * run ALL use cases if push to develop on main_v* * cast PosixPath to string to prevent crash when using Python 3.8.10 * feature 681 Modifed wording of regrid dictionary references (#916) Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> * bugfix 914 handle complex _VAR<n>_OPTIONS like MET dictionaries (#915) * added test to recreate error, then fix it * ci-run-diff * Feature 673 metviewer release (#910) Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> * Updated directions per Tara's instructions. * Added update_dtc_website.rst to metcalcpy and metplotpy subdirectories * .. include:: release_steps/met/update_dtc_website.rst * Corrected subdirectories from met to metcalcpy and metplotpy as needed * Feature 903 update users guide (#919) Co-authored-by: John Halley Gotway <johnhg@ucar.edu> * Fixes to automation to handle main_vX.Y branches (#920) * update version to show development towards 4.1.0-beta1 * changes made to main_v4.0 as bugfix to get docker data build to stop reporting a failure * generate union of sample data with subset to force a successful build to remove failed check * Added release guide for METexpress production releases. * Added announcement section to release guide for METexpress production releases. * Added rotate author section to release guide for METexpress production releases. * Fixed length of title underlines for METexpress release guide. * added useful logging messages to script that builds documentation so it is clear why it fails or if is succeeds * Added new alert: REQUIRED FOR RELEASE label to all the METplus repos. * modified steps for METplus to include updating release date and creating -ref branch to generate truth data for testing * Added more content to METdatadb release guides, following model of METcalcpy (#927) * added script to run on DTCenter web server to create a new input data directory for the next upcoming release and create symbolic links to the correct files from previous releases * feature 928 PCPCombine option to skip lookback in derive mode (#930) * Edits to METexpress release guide * feature 924 support extra options in RegridDataPlane (#929) * fixed minor bug in usage wrapper * strip off whitespace from version numbers so they are read correctly when installing as a package * Migrate issue and PR template changes from PR MET/#1803 into METplus develop branch. * Update README.md Adding GitHub Discussions info * changed non-unicode apostrophe and fixed typo in URL * feature 749 TCPairs refactor (#937) * removed file that should have been deleted in merge * Probability field threshold control in SeriesAnalysis (#942) * Somehow the required labels weren't present. Adding 2 required: labels as well as one for requestor: NASA/other. * feature 960 GenVxMask -type (#961) * feature 926 TCMPRPlotter improvements (#959) * changed variable name so that it does not overwrite author variable used in copyright * add missing quick search items (#962) * run pip freeze before use case commands to see python environment used to run in the logs * Feature 933 cartopy hpc (#964) * Modification to use NaturalEarth shapefiles that are already downloaded and saved to file in location designated by the CARTOPY_DIR environment. * Github Issue #933 Check for CARTOPY_DIR first, if unset, then proceed as before. * updated documentation for offline systems * Updated docs based on feedback Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> * Updated thumbnail path * Feature 963 quick search (#965) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 839 conda envs in automation (#967) * feature 641 MTD input to ExtractTiles (#968) Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu> * fixed documentation typos from bad merge * Feature 834 use case ice cover (#970) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * doc updates (#972) * fixed timing logs to show MM:SS instead of HH:MM * fixed typo in doc * feature 936 force MET version used for testing (#977) * moved logic for creating conda environments for metplus base and py_embed base to a script so it can be called on a local machine to create these environments * moved logic to update conda to docker file because update cannot be done on conda for a shared version * updated instructions to include steps to create conda environments on a local machine * Feature 963 quick search (#981) * Per #963, testing syntax * Per #963, testing syntax again after error * Per #963, testing string substitution * Per #963, trying dot dot slash * Per #963, found a relative path solution with dot dot slash, modified one line only * updating quick search from develop to working branch with dot dot slash * fixing typo * Per #963, removed replace directive since it is not being used * Per #963, testing change to Note section for keywords * Per #963, Testing return in note * Per #963, removed note section under keywords and moved down the png name. * Per #963, trying out various formatting options * Per #963, trying out various formatting options * Per #963, added additional keywords headers to get a better feel for what it would actually look like * Added numbers to keywords for easier referencing * Per #963, cleaned up examples and left with the formatting the team chose * Per #963, try out adding a code block around a sphinx_gallery_thumbnail_path to see if it disappears because remove_config_comments was already set to True in the conf.py file, but this only removes configuration comments from code blocks, not from text blocks. * Per #963, trying an additonal comment to eliminate sphinx_gallery_thumbnail_path * Per #963, removing additonal comment to eliminate sphinx_gallery_thumbnail_path because it got rid of the thumbnail image * Per #963, adding py to code-block to see if it eliminates sphinx_gallery_thumbnail_path * Per #963, removing the code-block because it does not get rid of sphinx_gallery_thumbnail_path * first attempt at note update without web links * updating keywords area * updating keywords area * updating keywords area * adding quick search link * fixing quick search link * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * deleting empty spaces * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * updating keywords area * fixing typo * updating keywords area * updating keywords area * updating keywords area * updating keywords area * Changed ASCII2NC to ASCII2NCToolUseCase * Modified list of keywords * Fixed typo Co-authored-by: Julie.Prestopnik <jpresto@ucar.edu> * Feature 956 develop discussions (#988) * Per 1833, changing met_help references to Discussions * Per #1833, changed references to met_help@ucar.edu to Discussions and updated a couple of other links. * Per #956, Fixed typo * Per #956, fixed section referring to Known Issues as suggested by John HG. * Per #956, removed met_help@ucar.edu reference. Checked to ensure author_email was not being used. * feature 986 TCPairs valid time (#997) * feature 986 TCPairs allow run all times when LOOP_ORDER = processes (#1013) * Feature 1002 user script files (#1014) * Update Blocking.py Added some comments * Update Blocking.py * Added mpr output * Added MPR output * Updated documentation * Fixed a path * Updates to documentation * call script to populate file list, output file list to output directory instead of under input base * added env file so pytests can run easily on seneca * improved logging readability * moved functions up to parent class so they can be used by UserScript * updated logic to match change to subset_input_files function return value * in run_at_time function loop over custom list and get files for the current run time before running since this function is called only if LOOP_BY=times and does not call the function that handles this -- consider refactoring to move logic for CUSTOM_LOOP_LIST so that it is handled consistently across all wrappers instead of being handled inside each * updated logic for UserScript to use the input dir/template variables to mimic logic in GridDiag to populate a list of files that are relevant for each run time of the use case * always return True from get_all_files for UserScript because handling file lists is optional * modified examples to call a script that checks environment variables and prints out the contents of file lists if they are set -- this better demonstrates how to use UserScript and how to get lists of files into a user's script, ci-run-diff * don't loop to find files if time info is not set * rerun use case that failed * trigger other failing use cases to run * changed name of config variable because name is now a reserved config variable * skip use cases that are no longer failing * Fixed a typo * add skip times logic to function that finds all files to process * added logic to put 'missing' for files that are not found for a given run time (for UserScript) * added an extra lead time to example to demonstrate handling of missing files * added logic to specify label for each input template file list, changed env var from METPLUS_<label> to METPLUS_FILELIST_<label>, changed user script example to find all keys that start with METPLUS_FILELIST_ to print * added a label to demonstrate functionality * added new config variables, ci-run-diff * added documentation for new functionality for UserScript wrapper to find file paths * Updated to use USER_SCRIPT text files * Fixed typo * Cleanup to .conf file * Cleanup to UserScript_obsERA_obsOnly_Blocking.conf * Updates to use the new file listing for UserScript * Cleanup to old python programs * Fixed a typo * change branch for METplotpy to feature branch to test changes * change METplotpy branch to develop since required change was merged into its develop branch * changed use cases back to new = false so they don't run every workflow Co-authored-by: Christina Kalb <kalb@ucar.edu> * Feature 615 gfdl tc tracking (#1020) Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> * fixed incorrect length of overline * error out if ouput data volumes fail to update * don't fail if no volumes to build * added error checking to script that updates docker data volumes that contain output truth data * skip diff for binary index files created from GFDL tracker * Feature 950 weather regime freq (#1024) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 952 blocking files (#1023) * Added output MPR file for Blocking * Cleanup and edits to creating mpr output * Fixed a typo * Added mpr output * Fixed a typo * Updated to use environment vars * Updates to blocking documentation * Delete conf file that was accidentally checked in * removed unused scripts Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 892 rmm omi drivers (#1028) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Changes for 4.1.0-beta1 release (#1027) * changed version for beta1 release * added release notes for 4.1.0-beta1 * removed unnecessary arguments to run_metplus.py * removed release notes item that is pushed to next beta * added line breaks between sections * added OMI and RMM use cases * update version to dev 4.1.0-beta2 * support skip times in example wrapper * Feature 759 fr met py (#1025) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated list of use cases to run in tests to reflect use case that was removed * remove log for copying files and modify log output for difference summary so it is easier to find * bugfix 1021 develop climo mean/stdev field (#1039) * fixed remove_quotes logic for handling config lists to only remove quotes around each value, not every quotation mark found -- changed logic for reading climo field to remove quotes around item to properly set dictionary items, ci-run-diff * fixed unit tests to reflect actual values to set for climo field * save script to update use case data directories on DTC web server * move step to update version number in develop branch right after creating release to minimize time that development will be done with the incorrect version number * removed step that is no longer needed after #963 * added step to set up next release data directory on DTC web server * updated wording to be more clear * Release Guide updates (#1041) * added newline after each difference summary item for better readability * use relative path for image * added content from the GitHub wiki so I could remove the wiki pages * feature 931 default wrapped MET config file (#1037) * updated info for _CONFIG_FILE variables in glossary * Feature 892 rmm omi tests (#1038) Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> * feature 951 add support for setting hss_ec_value (#1048) * Fix stale URL in GitHub issue and pull request templates. * changed import to prevent error if location of variable changes when the util directory is refactored * report error and exit if default metplus config files were somehow removed to prevent confusing errors that will result * updated error message to list parm directory where default confs are searched to help debugging * suggest that METPLUS_PARM_BASE may be the cause of the error * Added note to update information in conf.py file for release * updated link to instructions to upload data via FTP * feature 1057 pass directory to tcmpr plot script (#1085) * Feature 935 release guide (#1098) * Per #935, made updates to Release Guide * Per #935, made updates to Release Guide Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Changed component installation instructions to download MET as a tar file * changed key in use case group list from 'new' to 'run' to be more clear * Added lines to only build documentation for pull requests where only documentation changes have been made * Added quotes to echo on line 21 * Feature 874 doc (#1115) * Per #874, added information for the Release Guide and Verification Dataset Guide * Per #874, change to fix Unexpected indentation warning. * Added lines to only build documentation for pull requests where only documentation changes have been made Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Update task.md Testing addition of new default labels * Update task.md Fixing syntax issue with addition of new default labels * Update task.md Reverting to original text before changes made for addition of labels. * Added additional default labels * Feature 1062 pcp combine level template (#1118) * feature 1069 TCPairs write_valid, valid_inc, valid_exc (#1122) * Feature 1103 PointStat orank output_flag (#1124) * per comment in #1124, changed order of output flags to group related flags * Feature 617 gfdl etc (#1121) * added new use cases to existing use case group * Feature 1001 blocking statanalysis (#1125) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated instructions for updating the truth dataset reference branch * feature_1128_v4.1.0-beta2 (#1129) * update version for development towards next beta release * updated release guide instructions * update instructions to remove references to NCAR/METplus * Feature release guide (#1132) * Moved create_release_extra.rst into the release_steps area as all components except for METplus use the same file; Added instructions to update_dtc_website.rst * Removed text that was not supposed to be there. * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Update docs/Release_Guide/release_steps/common/update_dtc_website.rst Co-authored-by: johnhg <johnhg@ucar.edu> * Removed specific versions of update_dtc_website since they did not differ from the version in release_steps * Added variable - otherWebsiteUpdates - and its value. Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: johnhg <johnhg@ucar.edu> * changed to use PRMSL instead of MSLET for mean sea level pressure * Committing directly to develop for a minor documentation change. Add a release note step about formatting major/important changes in bold. * feature 1067 develop install instruct (#1156) * Per #1067, modified installation instructions and system configuration to point to installation instructions for MET * removed RTD python package requirements since they are already installed by RTD - fixes issue where bulleted lists bullets disappeared Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Removing version number from sphinx-gallery and adding one line to the update_release_notes files * Part of Github issue #1000 METplus: added font size for legend label * Github Issue #1000: major refactor to accommodate "sanitizing" of longitudes that could cross the International Date Line. * Correctly returning the track dictionary in the get_points_by_track() method. * removed extra import of pandas * Update use_case_groups.json * Cleaned up unneccessary comments and other things in retrieve_data() method. * Previous checkin was missing text due to IDE settings. * Add correction to retrieve_data() to create directory where ASCII csv file will be written * Clean up logic that writes the csv output file. * Reinstate saving the png file (final plot), initial checkin had hard-coded filename and location. * Add support for when no CYCLONE_PLOTTER_MODEL value is set and reindex the subsetted dataframe to avoid array indexing issues. * Add configuration setting for LOOP_BY * Added CYCLONE_PLOTTER_ANNOTATION_FONT_SIZE and modified size of the marker sizes to smaller values. * Updated config file with resolution setting, annotation size setting, and watermark on/off. * Remove unneccessary debug logging message * feature 1147 final conf sorting (#1152) * removed config variable that is no longer used/needed * cleaned up functions that handle setting CURRENT_[FCST/OBS]_[NAME/LEVEL] * clean up * expand path of config argument to run_metplus.py for easier debugging * removed redundant logic and added comments * cleanup * added logic to move config variables that are runtime specific to a [runtime] section in the final conf that is written after the run completes * changed how config arguments are read so that order that arguments are found is preserved instead of setting explicit overrides at the end * minor change to trigger build, ci-run-all-cases * rearranged logic to save list of config inputs with full paths for easier debugging * move all config vars that start with LOG or end with BASE to runtime section * remove vars that start with CURRENT from final conf * removed confusing logic allowing override of parm base and cleaned up logging to be easier to read/understand * added METPLUS_PARM_BASE env var logic back * added old vs. new default value mismatch info for pb_report_type in PB2NC config file * renamed config var name * use PARM_BASE instead of METPLUS_BASE/parm since it will still be set * use develop version of METviewer docker image (may need to make this configurable in testing.yml in the future) * run cyclone plotter use case to test that new conda environment in docker image now contains missing cartopy map files * added dockerfile to copy cartopy shape files into run image if cartopy is listed as dependencies * download script used to download cartopy shape files and run it * added copy of conda environment * added logic to download cartopy shape files for metplotpy environment * added cartopy dependency to use cases so the shapefiles are copied into run environment * trigger 1 use case that uses metplotpy_env to test cartopy shapefiles are found properly * added instructions to create weatherregime environment that was missing * cleaned up list of packages used * removed extra use case group used for testing * removed netcdf package from env because it is already installed and version number was causing a conflict * added cartopy shapefile copy to use case that needs it * download cartopy shape files for weatherregime python environment because files were not found from base env (metplotpy) * removed debug message that fills up log files with info that is not very useful * updated input directories to use _WeatherRegime directory instead of _Blocking * updated location of input data that was not found in UserScript_fcstGFS_obsERA_WeatherRegime * updated readme with info on how to install metplotpy/metcalcpy in conda environments * added 3rd group of cartopy shapefiles to download because they are used in weatherregime use cases * try using cartopy download script from forked repo that has missing shapefile zip file added * updated input paths to match new data locations * use master branch of SciTools/cartopy since pull request was merged * Feature 641 mtd feature relative (#1153) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1004 usecase ghrsst marine (#1182) * files for new use case * added new use case and mod files * upping verbosity for debug * more debugging * spelling fix * testing for climo issues * readded climo, changed python3 call in script * skip docker pull because docker create command will pull if needed, print full name of data volume used for easier debugging, no longer pass docker create command output to /dev/null because logic is no longer called from shell script (previously value was passed to script via std out so any logging info would be added to content) * moved new use case to its own section for testing * fixed typo * added PyEmbedIngest to process fcst/obs/climo data and read files into grid_stat to prevent out-of-memory errors * refactored script to try to reduce the amount of unnecessary memory the script uses * created config file to use PyEmbedIngest so use case can run as is on a machine with enough memory and run a modified version to work with the automated tests * removed use case from test suite because it uses more memory than the docker environment has available * removed old info * rearranged variables for readability, removed commented out variables Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Upload file for new use case * removed dependency on metplus function that is not needed * Github Issue #1000 added legend label fontsize and central longitude to configuration * Github Issue #1000 fix line plot (now use the Geodesic coordinate reference system), remove unneccessary code and comments, add support to read the central longitude from the config file. * feature 1089 add distance_map to GridStat (#1190) * Feature 1187 name update (#1193) * updated file names for use case * updated documentation for renaming, changing data * Update docs/Contributors_Guide/add_use_case.rst * split section into 2 sections for clarity * added info about removing old data from sample input data, added info about conda environments used for running use cases and automated tests, added text to make instructions more clear if one of two commands should be run * added missing parenthesis Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * v4.1.0-beta3 release (#1195) * updated version number for next development cycle * Remove the setting for the central longitude, this should ALWAYS be 180 to center the map over the Pacific Ocean * Change size of markers and remove setting for central longitude, this will always be set to 180 in the plotting script to center the map on the Pacific Ocean. * Change class variable names to be more informative, add better commenting, cleaning up code, moving hard-coded values from the plotting method into initialization section. * Added metplus-internal to list and changed /bin/sh to /bin/bash * Added metplus-internal * Removing alert: REQUIRED FOR RELEASE label in favor of already existing required labels for development and official release. * Add DOI. * Switch DOI to coordinated release. * Github issue #1000, using the suggested gridlines command from SciTools/cartopy#1401 and removing the original command of ax.gridlines(draw_labels=False, xlocs=[180, -180]) to prevent overlapping of 180E and 180W for central_longitude=180. Also fixed the sorting so the final ASCII (.csv) representation of the final data frame has been reindexed. * Update use_case_groups.json removed extra entry for met_tools to test the cycloneplotter wrapper earlier in the process. * Update installation.rst update cartopy version from 0.17 to 0.18 (the 0.18 version "fixes" the issue with overlapping 180/-180 longitude labels when the central longitude is set to 180). Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: George McCabe <mccabe@ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: John Halley Gotway <johnhg@ucar.edu> Co-authored-by: George McCabe <mccabe@dakota.rap.ucar.edu> Co-authored-by: Dan Adriaansen <dadriaan@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: mrinalbiswas <biswas@ucar.edu> Co-authored-by: Keith Searight <keith.searight@noaa.gov> Co-authored-by: Keith Searight <searight@ucar.edu> Co-authored-by: Molly Smith <molly.b.smith@noaa.gov> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: MET Tools Test Account <met_test@kiowa.rap.ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: Tatiana Burek <tatiana@ucar.edu> Co-authored-by: Venita Hagerty <38571614+venitahagerty@users.noreply.github.com> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: George McCabe <mccabe@seneca.rap.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne1.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne5.cheyenne.ucar.edu> Co-authored-by: George McCabe <mccabe@cheyenne4.cheyenne.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@seneca.rap.ucar.edu> Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu>

* first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json * only trigger testing workflow for pull requests that are going into develop or main_* branches * Feature 1371 blocking wr (#1426) * turn off use cases for push events * Feature 1392 climo_cdf.direct_prob and SeriesAnalysis (#1396) * Changed event triggering rules for documentation workflow so that it will run for pull requests even if no files in the docs directory have changed. A recent pull request passed but develop failed after it was approved because files that were referenced in the use case documentation files had been deleted as part of the PR. * feature 1273 TCGen -edeck and -shape (#1424) * Feature 966 Fix mask.poly logic (#1430) * Feature 1030 total seconds documentation (#1428) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * get branch name in job controls job * replace logic to update input data volumes with call to dtcenter/metplus-action-data-update action * feature 1431 remove obs_prepbufr_map (#1433) * Per #675, added images and updated content * added statsmodel package to metplotpy docker conda environment * Added fcst_file_type to two wrappers (#1437) Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added release notes for tasks that have already been completed for beta6 * updated env var for METplotpy base to match changes made to the METplotpy repository * Updated METplotpy base env var to preemptively match changes from PR dtcenter/METplotpy#197. Once that PR is merged into develop, a test workflow will run that should fix this issue. * removed commented code that is no longer used * update the instructions for updating test input data to ensure volume_mount_directories file is updated in the upcoming version directory, i.e. v4.1, so that the Docker data volumes from the release will be created properly * removed duplicate script * updated script to copy volume_mount_directories file into new METplus version directory * added logic to skip files that are temporary copies of tar files that should not be added to new version directory * updated release guide instructions for creating METplus data directory for next development cycle * Feature 911 tc trackint (#1439) Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added new use cases that are currently being reviewed to release notes * updated event info in contributor's guide * Feature 626 fix hovmoeller documentation (#1444) * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py replace hovmoeller_diagram.conf with UserScript_obsPrecip_obsOnly_Hovmoeller.conf * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py Removed a typo: UserScript This uses data from... Now: This uses data from... * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py * Modified the PR template to add review of the source issue metadata ci-skip-all * feature_1403_python_components_table (#1446) * creating new METplus Components Python Requirements * adding a return to test * testing use case links * testing use case links #2 * testing use case links #3 * testing use case links #4 * Filling in some use cases * fixing indentation #1403 * fixing indentation #1403 take 2 * fixing indentation #1403 take 3 * cleaning up anything after # in the links #1403 * entries thru D #1403 * entries thru H #1403 * fixing indents #1403 * fixing indents #1403 take 2 * fixing web name #1403 * entries thru L #1403 * entry matplotlib #1403 * entry matplotlib #1403 marking duplicate names * entry metcalcpy #1403 * entry metcalcpy fix indents #1403 * entry matplotlib #1403 fixing duplicate names * entry metplotpy #1403 * entry metplotpy #1403 marking duplicate names * entry metplotpy #1403 fixing * entry thru ps #1403 * double names #1403 * character fix #1403 * adding in missing links #1403 * thru pyproj #1403 * problem with line 353 #1403 * thru pyproj #1403 typos * more duplicate names #1403 * line break #1403 * loose ends #1403 * adding >= to some of the versions #1403 * adding name to the Use Cases to avoid duplicate naming issues TEST #1403 * adding name to the Use Cases to avoid duplicate naming issues thru pyproj #1403 * adding thru pyresample #1403 * fixing pyresample typo #1403 * adding thru scikit-image #1403 * fixing line breaks#1403 * web links thru scikit-learn #1403 * web links thru scipy #1403 * web links thru sklearn #1403 * Duplicate web names. temp. fix #1403 * Duplicate web names fixed #1403 * Duplicate web names fixing #3 #1403 * Duplicate web names fixing #4 #1403 * Duplicate web names fixing #5 #1403 * table end #1403 * table loose ends #1403 * Removed unnecessary comma * table loose ends after pull request #1403 * Minor modifications to METplus Component column * Changed description of pyproj * Added link for last referenced use case * Attempting to fix doc warning Co-authored-by: jprestop <jpresto@ucar.edu> * Feature 1318 usecase aviso (#1440) * Correct small typo. * Update pull_request_template.md * Added files for ReadTheDocs (#864) * Updated documentation links for ReadtheDocs * Update pull_request_template.md Added entry for completion date for pull request review. * Adding python embedding script to read AVISO, RTOFS, HYCOM and OSTIA data * Updated the script - working but only RMSE values match * Adding documentation for the AVISO case * Adding a conf file for the AVISO case * Updates to the codel to include model3, obs, climo3 but also has many extra print statements, netcdf output files which needs to be cleaned * Cleaning up the conf file and adding SAL1L2 to get the model_climo sdev and obs_climo sdev * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Adding an image to the use case. Image Courtesy: EMC/NOAA website * added to use case list * updated case description * removed merge issues * caught second docs issue * removed other doc merge issues, turned off auto test * more merge comments sneaking in Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json * only trigger testing workflow for pull requests that are going into develop or main_* branches * Feature 1371 blocking wr (#1426) * turn off use cases for push events * Feature 1392 climo_cdf.direct_prob and SeriesAnalysis (#1396) * Changed event triggering rules for documentation workflow so that it will run for pull requests even if no files in the docs directory have changed. A recent pull request passed but develop failed after it was approved because files that were referenced in the use case documentation files had been deleted as part of the PR. * feature 1273 TCGen -edeck and -shape (#1424) * Feature 966 Fix mask.poly logic (#1430) * Feature 1030 total seconds documentation (#1428) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * get branch name in job controls job * replace logic to update input data volumes with call to dtcenter/metplus-action-data-update action * feature 1431 remove obs_prepbufr_map (#1433) * Per #675, added images and updated content * added statsmodel package to metplotpy docker conda environment * Added fcst_file_type to two wrappers (#1437) Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added release notes for tasks that have already been completed for beta6 * updated env var for METplotpy base to match changes made to the METplotpy repository * Updated METplotpy base env var to preemptively match changes from PR dtcenter/METplotpy#197. Once that PR is merged into develop, a test workflow will run that should fix this issue. * removed commented code that is no longer used * update the instructions for updating test input data to ensure volume_mount_directories file is updated in the upcoming version directory, i.e. v4.1, so that the Docker data volumes from the release will be created properly * removed duplicate script * updated script to copy volume_mount_directories file into new METplus version directory * added logic to skip files that are temporary copies of tar files that should not be added to new version directory * updated release guide instructions for creating METplus data directory for next development cycle * Feature 911 tc trackint (#1439) Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added new use cases that are currently being reviewed to release notes * updated event info in contributor's guide * Feature 626 fix hovmoeller documentation (#1444) * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py replace hovmoeller_diagram.conf with UserScript_obsPrecip_obsOnly_Hovmoeller.conf * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py Removed a typo: UserScript This uses data from... Now: This uses data from... * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py * Modified the PR template to add review of the source issue metadata ci-skip-all * feature_1403_python_components_table (#1446) * creating new METplus Components Python Requirements * adding a return to test * testing use case links * testing use case links #2 * testing use case links #3 * testing use case links #4 * Filling in some use cases * fixing indentation #1403 * fixing indentation #1403 take 2 * fixing indentation #1403 take 3 * cleaning up anything after # in the links #1403 * entries thru D #1403 * entries thru H #1403 * fixing indents #1403 * fixing indents #1403 take 2 * fixing web name #1403 * entries thru L #1403 * entry matplotlib #1403 * entry matplotlib #1403 marking duplicate names * entry metcalcpy #1403 * entry metcalcpy fix indents #1403 * entry matplotlib #1403 fixing duplicate names * entry metplotpy #1403 * entry metplotpy #1403 marking duplicate names * entry metplotpy #1403 fixing * entry thru ps #1403 * double names #1403 * character fix #1403 * adding in missing links #1403 * thru pyproj #1403 * problem with line 353 #1403 * thru pyproj #1403 typos * more duplicate names #1403 * line break #1403 * loose ends #1403 * adding >= to some of the versions #1403 * adding name to the Use Cases to avoid duplicate naming issues TEST #1403 * adding name to the Use Cases to avoid duplicate naming issues thru pyproj #1403 * adding thru pyresample #1403 * fixing pyresample typo #1403 * adding thru scikit-image #1403 * fixing line breaks#1403 * web links thru scikit-learn #1403 * web links thru scipy #1403 * web links thru sklearn #1403 * Duplicate web names. temp. fix #1403 * Duplicate web names fixed #1403 * Duplicate web names fixing #3 #1403 * Duplicate web names fixing #4 #1403 * Duplicate web names fixing #5 #1403 * table end #1403 * table loose ends #1403 * Removed unnecessary comma * table loose ends after pull request #1403 * Minor modifications to METplus Component column * Changed description of pyproj * Added link for last referenced use case * Attempting to fix doc warning Co-authored-by: jprestop <jpresto@ucar.edu> * Feature 1318 usecase aviso (#1440) * Correct small typo. * Update pull_request_template.md * Added files for ReadTheDocs (#864) * Updated documentation links for ReadtheDocs * Update pull_request_template.md Added entry for completion date for pull request review. * Adding python embedding script to read AVISO, RTOFS, HYCOM and OSTIA data * Updated the script - working but only RMSE values match * Adding documentation for the AVISO case * Adding a conf file for the AVISO case * Updates to the codel to include model3, obs, climo3 but also has many extra print statements, netcdf output files which needs to be cleaned * Cleaning up the conf file and adding SAL1L2 to get the model_climo sdev and obs_climo sdev * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Adding an image to the use case. Image Courtesy: EMC/NOAA website * added to use case list * updated case description * removed merge issues * caught second docs issue * removed other doc merge issues, turned off auto test * more merge comments sneaking in Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu>

* Feature 1091 extent cycloneplotter (#1218) * Github #1091 add support to define plot's extent * Github #1091 Add support for defining plot's extent * Github #1091 add support for defining plot extent * GitHub #1091 Provide support to define plotting a bounding box of interest and replace deprecated cartopy attributes. * Github Issue #1091 Add configuration support to define the bounding box defining the area of interest to plot. * Github Issue #1091 provide support to define bounding box defining the area of interest to plot. * Github Issue #1091 Removed unused shapely imports * GItHub Issue #1091 Removed duplicate CYCLONE_PLOTTER_GLOBAL_PLOT * Github #1091 Include config settings needed to indicate the region of interest to be plotted. * Github Issue #1091 Keep only the North Hemisphere lon and lats in the config file to serve as example for plotting a specific area of the map. * convert file back to unix format via dos2unix and added change that was lost in merge * return None from function instead of exiting so that METplus clean up functionality will still run * fixed indentation * fixed indentation - for loop should not be nested inside other for loop * fixed check for failure in retrieve_data function * feature 1223 error if file not found (#1238) * feature 1252 allow dictionary value for time_summary.width (#1253) * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json * only trigger testing workflow for pull requests that are going into develop or main_* branches * Feature 1371 blocking wr (#1426) * turn off use cases for push events * Feature 1392 climo_cdf.direct_prob and SeriesAnalysis (#1396) * Changed event triggering rules for documentation workflow so that it will run for pull requests even if no files in the docs directory have changed. A recent pull request passed but develop failed after it was approved because files that were referenced in the use case documentation files had been deleted as part of the PR. * feature 1273 TCGen -edeck and -shape (#1424) * Feature 966 Fix mask.poly logic (#1430) * Feature 1030 total seconds documentation (#1428) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * get branch name in job controls job * replace logic to update input data volumes with call to dtcenter/metplus-action-data-update action * feature 1431 remove obs_prepbufr_map (#1433) * Per #675, added images and updated content * added statsmodel package to metplotpy docker conda environment * Added fcst_file_type to two wrappers (#1437) Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added release notes for tasks that have already been completed for beta6 * updated env var for METplotpy base to match changes made to the METplotpy repository * Updated METplotpy base env var to preemptively match changes from PR dtcenter/METplotpy#197. Once that PR is merged into develop, a test workflow will run that should fix this issue. * removed commented code that is no longer used * update the instructions for updating test input data to ensure volume_mount_directories file is updated in the upcoming version directory, i.e. v4.1, so that the Docker data volumes from the release will be created properly * removed duplicate script * updated script to copy volume_mount_directories file into new METplus version directory * added logic to skip files that are temporary copies of tar files that should not be added to new version directory * updated release guide instructions for creating METplus data directory for next development cycle * Feature 911 tc trackint (#1439) Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added new use cases that are currently being reviewed to release notes * updated event info in contributor's guide * Feature 626 fix hovmoeller documentation (#1444) * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py replace hovmoeller_diagram.conf with UserScript_obsPrecip_obsOnly_Hovmoeller.conf * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py Removed a typo: UserScript This uses data from... Now: This uses data from... * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py * Modified the PR template to add review of the source issue metadata ci-skip-all * feature_1403_python_components_table (#1446) * creating new METplus Components Python Requirements * adding a return to test * testing use case links * testing use case links #2 * testing use case links #3 * testing use case links #4 * Filling in some use cases * fixing indentation #1403 * fixing indentation #1403 take 2 * fixing indentation #1403 take 3 * cleaning up anything after # in the links #1403 * entries thru D #1403 * entries thru H #1403 * fixing indents #1403 * fixing indents #1403 take 2 * fixing web name #1403 * entries thru L #1403 * entry matplotlib #1403 * entry matplotlib #1403 marking duplicate names * entry metcalcpy #1403 * entry metcalcpy fix indents #1403 * entry matplotlib #1403 fixing duplicate names * entry metplotpy #1403 * entry metplotpy #1403 marking duplicate names * entry metplotpy #1403 fixing * entry thru ps #1403 * double names #1403 * character fix #1403 * adding in missing links #1403 * thru pyproj #1403 * problem with line 353 #1403 * thru pyproj #1403 typos * more duplicate names #1403 * line break #1403 * loose ends #1403 * adding >= to some of the versions #1403 * adding name to the Use Cases to avoid duplicate naming issues TEST #1403 * adding name to the Use Cases to avoid duplicate naming issues thru pyproj #1403 * adding thru pyresample #1403 * fixing pyresample typo #1403 * adding thru scikit-image #1403 * fixing line breaks#1403 * web links thru scikit-learn #1403 * web links thru scipy #1403 * web links thru sklearn #1403 * Duplicate web names. temp. fix #1403 * Duplicate web names fixed #1403 * Duplicate web names fixing #3 #1403 * Duplicate web names fixing #4 #1403 * Duplicate web names fixing #5 #1403 * table end #1403 * table loose ends #1403 * Removed unnecessary comma * table loose ends after pull request #1403 * Minor modifications to METplus Component column * Changed description of pyproj * Added link for last referenced use case * Attempting to fix doc warning Co-authored-by: jprestop <jpresto@ucar.edu> * Feature 1318 usecase aviso (#1440) * Correct small typo. * Update pull_request_template.md * Added files for ReadTheDocs (#864) * Updated documentation links for ReadtheDocs * Update pull_request_template.md Added entry for completion date for pull request review. * Adding python embedding script to read AVISO, RTOFS, HYCOM and OSTIA data * Updated the script - working but only RMSE values match * Adding documentation for the AVISO case * Adding a conf file for the AVISO case * Updates to the codel to include model3, obs, climo3 but also has many extra print statements, netcdf output files which needs to be cleaned * Cleaning up the conf file and adding SAL1L2 to get the model_climo sdev and obs_climo sdev * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Adding an image to the use case. Image Courtesy: EMC/NOAA website * added to use case list * updated case description * removed merge issues * caught second docs issue * removed other doc merge issues, turned off auto test * more merge comments sneaking in Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * Revert "Feature 1318 usecase aviso (#1440)" (#1459) This reverts commit d3021de. Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu>

* thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * feature 1252 allow dictionary value for time_summary.width (#1253) * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * creating a separate list for diagnostics, in progesss * removing diagnostics from statistics, in progess #1049 * adding diagnostics_list to TOC #1049 * separating lists * fixing typos #1049 * moving blank statistic type from statistics to diagnostics #1049 * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * fixing errors #1049 * updating table name #1049 * fixing typo #1049 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * putting both tables into one chapter * removing diagnostics since it's going back into the statistics chapter #1049 * Delete diagnostics_list.rst This table will be added to the statistics page as a separate table. #1049 * test. breaking out directories A-B and C-D #1049 * testing with section names #1049 * alphbetical sections for statistics #1049 * making U-Z statistics list #1049 * alpabetical breaks for diagnostics list #1049 * trying to fix errors #1049 * trying to fix errors take 2 #1049 * trying to fix errors take 3 #1049 * Removed a unnecessary space #1049 * Making all METplus Names CAPITAL LETTERS #1049 * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json * only trigger testing workflow for pull requests that are going into develop or main_* branches * Feature 1371 blocking wr (#1426) * turn off use cases for push events * Feature 1392 climo_cdf.direct_prob and SeriesAnalysis (#1396) * Changed event triggering rules for documentation workflow so that it will run for pull requests even if no files in the docs directory have changed. A recent pull request passed but develop failed after it was approved because files that were referenced in the use case documentation files had been deleted as part of the PR. * feature 1273 TCGen -edeck and -shape (#1424) * Feature 966 Fix mask.poly logic (#1430) * Feature 1030 total seconds documentation (#1428) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * get branch name in job controls job * replace logic to update input data volumes with call to dtcenter/metplus-action-data-update action * feature 1431 remove obs_prepbufr_map (#1433) * Per #675, added images and updated content * added statsmodel package to metplotpy docker conda environment * Added fcst_file_type to two wrappers (#1437) Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added release notes for tasks that have already been completed for beta6 * updated env var for METplotpy base to match changes made to the METplotpy repository * Updated METplotpy base env var to preemptively match changes from PR dtcenter/METplotpy#197. Once that PR is merged into develop, a test workflow will run that should fix this issue. * removed commented code that is no longer used * update the instructions for updating test input data to ensure volume_mount_directories file is updated in the upcoming version directory, i.e. v4.1, so that the Docker data volumes from the release will be created properly * removed duplicate script * updated script to copy volume_mount_directories file into new METplus version directory * added logic to skip files that are temporary copies of tar files that should not be added to new version directory * updated release guide instructions for creating METplus data directory for next development cycle * Feature 911 tc trackint (#1439) Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added new use cases that are currently being reviewed to release notes * updated event info in contributor's guide * Feature 626 fix hovmoeller documentation (#1444) * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py replace hovmoeller_diagram.conf with UserScript_obsPrecip_obsOnly_Hovmoeller.conf * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py Removed a typo: UserScript This uses data from... Now: This uses data from... * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py * Modified the PR template to add review of the source issue metadata ci-skip-all * feature_1403_python_components_table (#1446) * creating new METplus Components Python Requirements * adding a return to test * testing use case links * testing use case links #2 * testing use case links #3 * testing use case links #4 * Filling in some use cases * fixing indentation #1403 * fixing indentation #1403 take 2 * fixing indentation #1403 take 3 * cleaning up anything after # in the links #1403 * entries thru D #1403 * entries thru H #1403 * fixing indents #1403 * fixing indents #1403 take 2 * fixing web name #1403 * entries thru L #1403 * entry matplotlib #1403 * entry matplotlib #1403 marking duplicate names * entry metcalcpy #1403 * entry metcalcpy fix indents #1403 * entry matplotlib #1403 fixing duplicate names * entry metplotpy #1403 * entry metplotpy #1403 marking duplicate names * entry metplotpy #1403 fixing * entry thru ps #1403 * double names #1403 * character fix #1403 * adding in missing links #1403 * thru pyproj #1403 * problem with line 353 #1403 * thru pyproj #1403 typos * more duplicate names #1403 * line break #1403 * loose ends #1403 * adding >= to some of the versions #1403 * adding name to the Use Cases to avoid duplicate naming issues TEST #1403 * adding name to the Use Cases to avoid duplicate naming issues thru pyproj #1403 * adding thru pyresample #1403 * fixing pyresample typo #1403 * adding thru scikit-image #1403 * fixing line breaks#1403 * web links thru scikit-learn #1403 * web links thru scipy #1403 * web links thru sklearn #1403 * Duplicate web names. temp. fix #1403 * Duplicate web names fixed #1403 * Duplicate web names fixing #3 #1403 * Duplicate web names fixing #4 #1403 * Duplicate web names fixing #5 #1403 * table end #1403 * table loose ends #1403 * Removed unnecessary comma * table loose ends after pull request #1403 * Minor modifications to METplus Component column * Changed description of pyproj * Added link for last referenced use case * Attempting to fix doc warning Co-authored-by: jprestop <jpresto@ucar.edu> * Feature 1318 usecase aviso (#1440) * Correct small typo. * Update pull_request_template.md * Added files for ReadTheDocs (#864) * Updated documentation links for ReadtheDocs * Update pull_request_template.md Added entry for completion date for pull request review. * Adding python embedding script to read AVISO, RTOFS, HYCOM and OSTIA data * Updated the script - working but only RMSE values match * Adding documentation for the AVISO case * Adding a conf file for the AVISO case * Updates to the codel to include model3, obs, climo3 but also has many extra print statements, netcdf output files which needs to be cleaned * Cleaning up the conf file and adding SAL1L2 to get the model_climo sdev and obs_climo sdev * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Adding an image to the use case. Image Courtesy: EMC/NOAA website * added to use case list * updated case description * removed merge issues * caught second docs issue * removed other doc merge issues, turned off auto test * more merge comments sneaking in Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * Revert "Feature 1318 usecase aviso (#1440)" (#1459) This reverts commit d3021de. * Feature 1449 v4.1.0 beta6 (#1461) * Per #1449, updated version as specified in the Release Guide * Per #1449, updated release notes * Updated release date for beta6 release Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * updated version number after beta release * Feature 1318 usecase aviso attempt 2 (#1473) Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu> * error if no input template is set for GridDiag wrapper * added comment for new logic, ci-run-diff * updated old section name to config, ci-run-all-diff * fixed bug with replacing wildcard characters with 'all' in output file paths * Revert "fixed bug with replacing wildcard characters with 'all' in output file paths" This reverts commit c11711e. * fixed bug with replacing wildcard characters with 'all' in output file paths, ci-run-all-diff * feature 1102 -out for TCStat and StatAnalysis (#1477) * feature 1464 EnsembleStat probabilistic additions (#1479) * feature 1445 normalize in GenEnsProd (#1478) * added logic to add quotes around grid value if they are not set in conf variable value, moved error check for unset grid to init step, ci-run-all-diff * bugfix 1486 PB2NC file window variables not read (#1487) * added build arg to override MET DockerHub repository so development version tests can use dtcenter/met-dev:develop * set MET DockerHub repo based on develop or stable version of METplus * run diff logic for push events to develop and main_v* branches so we can catch if changes to external repositories caused differences in the output * do not run diff logic on main_v* and develop branch push events -- diff logic is already running when external repository triggers workflow, which is what we need to test with the diff logic * Added description for Use Cases * updated script to set up new release input data directories -- use real path for all symbolic links for consistency, added usage statement * changed logic to error if new version directory to create already exists at all -- previous logic only errors if directory is not empty * Changed all filename template tags for datetime objects (init/valid/da_init/etc.) to use %H instead of %2H. We discovered that Python 3.6.8 interprets %2H as the same as %H (correctly substituting the hour), however Python 3.8.8 interprets %2H as 2H. The number in between the % and letter is not supported by strftime so it is not valid for these datetime values. The logic to zero-pad using this notation was written in the METplus string substitution logic and only applies to lead and level template tags. ci-run-all-diff * feature 1274 TCGen use case using -shape/-genesis (#1492) Co-authored-by: Kathryn Newman <knewman@seneca.rap.ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> * feature 1490 Python Embedding for Point Observations (#1491) * update use case groupings for automated tests * removed extra comma typo, ci-run-all-diff * added missing characters in commmands * Feature 1403 python components table (#1497) Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * testing new statistics provided by Tara #1049 * testing new statistics #2 #1049 * New statistics from Tara #1049 * New statistics from Tara small corrections #1049 * New statistics from Tara small corrections #2 #1049 * New statistics from Tara small moving to Diagnostics table #1049 * Fixing space-time, like that's possible #1049 * Fixing spacing #1049 * feature 1471 fix current field info in output_prefix (#1500) * Feature 1503 v4.1.0 rc1 (#1504) * update version after rc1 release to reflect development towards 4.1.0 release * Corrected documentation title name * bugfix 1486 pb2nc window variables (#1507) * feature 1443 document probabilistic field settings (#1508) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 943 document referencing current level (#1509) * feature 1510 v4.1.0 Release (#1511) * updated release guide to reflect updated process to trigger reference branch GHA workflow for an official release * update version to reflect development towards 5.0.0-beta1 release * Feature 673 MET (#1517) * set MET docker repo to dtcenter/met if forcing a specific MET tag to use since that is where the stable release versions are stored on DockerHub * pass variable to tell docker build script that an external workflow triggered the run and use -lite if so to ensure that MET docker image that was created by the triggering MET workflow is used * echo output variables from job control job so they can be reviewed in the GHA log output * minor fix for consistency in logs, ci-skip-all * Feature 1399 usecase cable (#1538) * Adding initial code to read AOML Cable Transport and RTOFS cable transport variables * Updating the conf file (no stat analysis yet) and updates to the read file * Updating the conf file to add STAT_ANALYSIS * Updates to the code- adding stats * Updated code--runs now but needs to follow User Script conventions * Changed directory name based on MET conventions * Updating the read file and adding a conf file * Added logic to count the number of directories in the RTOFS dir * Updated to run with UserScript conf * update version for official release * Adding a yaml file to specify start_date * Added the yaml file and cleaned up the conf file * Added logic to read the yaml file, cleaned up the script * Updating the confile to add output dir, input template and clean up * Removing yaml, getting vDate from conf file, adding output file * Adding the doc file for the cable use case * Adding image courtesy NOAA * Adding more documentation * Adding more info * Updated docs * Correcting the python embedding script * Updating to see if the error goes away..no clue * Fixing the doc error * modifed docs, testing * updated permissions for script * turned off always testing * Updated version number * Update use_case_groups.json * Removed erroneous file * Apply suggestions from code review * Update .github/parm/use_case_groups.json Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: Kathryn Newman <knewman@seneca.rap.ucar.edu>

* thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * feature 1252 allow dictionary value for time_summary.width (#1253) * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * feature 1213 obs_quality_inc/exc (#1260) * Feature 1203 ioda2nc (#1262) * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup * Add default title for the new use case issue template. * Feature 1019 harmonic preprocessing (#1272) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Feature 1266 gen ens prod missing ensembles (#1275) * Feature 1049 statistics list (#1271) * first attempt at a table #1049 * 2nd attempt, smaller, different formatting table #1049 * trying to get rid of git error message by adding this to the index #1049 * alignment #1049 * trying to text wrap in a table #1049 * attempting to create text wrapping in tables #1049 * removing role, trying to wrap text #1049 * removing html break, trying to wrap text #1049 * adding code to wrap text #1049 * removing code to wrap text #1049 * fixing naming typo #1049 * hitting returns in table #1049 * removing typo file, removing line breaks #1049 * attempting a simple table for text wrapping #1049 * attempting to bold header row in simple table #1049 * simple table line break attempt #1049 * simple table line break attempt #2 #1049 * simple table line break attempt #3 #1049 * trying another | #1049 * 2 trying another | #1049 * 3 trying another | #1049 * trying a blank line #1049 * trying reformating grid #1049 * 2 trying reformating grid #1049 * 3 trying reformating grid #1049 * 4 trying reformating grid #1049 * adding in one more table row #1049 * adding more text #1049 * trying glossary format #1049 * 2 trying glossary format #1049 * 3 trying glossary format #1049 * 4 trying glossary format #1049 * adding glossary format 2D objects #1049 * fixing glossary format 2D objects #1049 * adding glossary items #1049 * fixing glossary format #1049 * hopefully all examples are working #1049 * changing reference to tool * removing 2D object examples * removing the unwrapped table * adding ACC into the example * fixing formatting #1049 * fixing formatting take 2 #1049 * fixing formatting take 3 #1049 * bolding and language change #1049 * fixing spacing #1049 * fixing spacing again #1049 * changing title #1049 * trying superscript #1049 * superscript glossary #1049 * removing quotes #1049 * fixing spacing #1049 * Tara has decided to go with the glossary format. Removing table example. #1049 * Adding 2D objects #1049 * 2D objects fix #1049 * 2D objects fix attempt 2 #1049 * 2D objects fix attempt 3 #1049 * 2D objects fix attempt 4 #1049 * 2D objects fix attempt 5 #1049 * 2D objects fix attempt 7 #1049 * 2D objects fix attempt 8 #1049 * ABR added #1049 * adding remaining AB items to list #1049 * adding remaining ACC_ items to list #1049 * ADLAND & AFSS entries #1049 * A entries #1049 * fixing formatting #1049 * fixing formatting #2 #1049 * removing new entries to make it run #1049 * adding a couple back in #1049 * adding a couple more back in #1049 * tool key at the bottom #1049 * spacing changes #1049 * spacing changes another try #1049 * fixing spacing #1049 * fixing spacing attempt 2 #1049 * fixing spacing attempt 3 #1049 * through AREA items #1049 * AMODEL listed twice but it's not #1049 * AMODEL listed twice but it's not #2 #1049 * AMODEL added question marks so it will run #1049 * final A entries #1049 * naming the glossary statistics in hopes of not conflicting with original glossary #1049 * removing glossary statistics space #1049 * Testing multiple glossary names * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, working on attempts to have multiple glossaries with the same term * Per #1067, removing code with attempts at mutiple glossaries * Per #1067, adding back three question marks due to duplicate term * paring down list, adding a table for review * problems with table * still trying to get it to publish * still trying to get a second line in the table * still trying to get a second line in the table 2 * testing different formatting * testing different formatting * trying to comment out the glossary inner workings * formatting again * line breaks in table #1049 * adding in some more for an example #1049 * adding new entries in through AREA #1049 * fixing line breaks #1049 * fixing line breaks #1049 #2 * fixing line breaks and warning messages #1049 * fixing line breaks #1049 * adding AREA_RATIO through ASPECT_DIFF * fixing typo #1049 * fixing typo #1049 * fixing typo #1049 take 2 * adding AXIS_ANG to BCMSE #1049 * adding spacing #1049 * adding spacing removing commas #1049 * removing comma #1049 * BOUNDARY_DIST thru BSS_SMPL #1049 * BOUNDARY_DIST splitting across 2 lines #1049 * cleaning up typos #1049 * calibration thru centriod_dist #1049 * centriod_lat thru centroid_y #1049 * fixing spacing #1049 * removing test glossary #1049 * climo_mean thru crtk_err #1049 * fixing crtk_err spacing #1049 * fixing spacing #1049 * CSI to CURVATURE_Y #1049 * CURVATURE_X & Y spacing #1049 * DEV_CAT to DURATION_DIFF #1049 * EC_VALUE to F #1049 * F_RATE TO FBS #1049 * Fixing spacing #1049 * fcst_clus thru fcst_conv_radius #1049 * removing CTOP_PRS #1049 * fixing the order of tools for FBAR and FBIAS #1049 * fixing spacing #1049 * adding grid-stat to all point-stat entries #1049 * adding fixing spacing #1049 * adding fixing spacing take 2 #1049 * adding fixing spacing take 3 #1049 * adding fixing spacing take 4 #1049 * adding fixing spacing take 5 #1049 * adding fixing spacing take 6 #1049 * adding fixing spacing take 7 #1049 * fixing spacing with a period take 7 #1049 * first attempt fcst_ #1049 * fixing typos #1049 * thru FOBAR #1049 * thru end of F #1049 * g thru h #1049 * i thru intensity #s #1049 * fixing typos #1049 * capturing example for Julie #1049 * thru k #1049 * fixing typos #1049 * thru L #1049 * thru MG #1049 * thru N_ENS #1049 * thru all N #1049 * fixing FBIAS alignment #1049 * fixing ME and MSE alignment #1049 * fixing ME alignment take 2 #1049 * thru OBS_E #1049 * fixing alignment #1049 * fixing alignment n_thresh #1049 * thru OBS_thresh #1049 * thru O #1049 * fixing OOBAR formating #1049 * thru PR_CORR #1049 * commented lines out with line total info #1049 * commented lines out with line total info take 2 #1049 * thru R #1049 * thru SPEED #1049 * thru S #1049 * thru T #1049 * thru U #1049 * thru V #1049 * thru V #1049 * thru Z #1049 * Update statistics_list.rst Tara is testing editing in UI * Update statistics_list.rst Updates through the A's * Update statistics_list.rst Cleaning up the A's * Update statistics_list.rst Standardizing MODE and MTD entries * Update statistics_list.rst Updating B's and C's * Update statistics_list.rst Testing adding TC-Stat and TCST to an entry * Update statistics_list.rst Clean up of a few A-Cs and then update of Ds * Update statistics_list.rst A few clean-ups and Es * Update statistics_list.rst Halfway through Fs... * Update statistics_list.rst A little clean up and the rest of Fs * Update statistics_list.rst G, H, I, Ks * Update statistics_list.rst L, M, Ns * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst A little clean-up and Os * Update statistics_list.rst Rs * Update statistics_list.rst S and Ts * Update statistics_list.rst The rest of the list * Update statistics_list.rst Removed Attr from Stat Type thru E * Update statistics_list.rst Remove Attr from Statistics Type through Gs * Update statistics_list.rst Remove Attr from Statistic Type through Rs * Update statistics_list.rst Remove Attr from Stat Type to the end * Update statistics_list.rst Cleaned up some Line Type typos * Update statistics_list.rst Still more Attr cleanup Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> * creating a separate list for diagnostics, in progesss * removing diagnostics from statistics, in progess #1049 * adding diagnostics_list to TOC #1049 * separating lists * fixing typos #1049 * moving blank statistic type from statistics to diagnostics #1049 * Feature 1263 v4.1.0 beta4 (#1277) * update version to note development towards beta5 * fixing errors #1049 * updating table name #1049 * fixing typo #1049 * Feature 934 release stage doc (#1235) * Per #934 add stages of the METplus release cycle. * Per #934, adding link to descriptions of the release cycle in the User's Guide. * Per #934, made corrections * Per #934, changed Beta and Release Candidate (rc) from bold to subsubsections. * Update index.rst Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * putting both tables into one chapter * removing diagnostics since it's going back into the statistics chapter #1049 * Delete diagnostics_list.rst This table will be added to the statistics page as a separate table. #1049 * test. breaking out directories A-B and C-D #1049 * testing with section names #1049 * alphbetical sections for statistics #1049 * making U-Z statistics list #1049 * alpabetical breaks for diagnostics list #1049 * trying to fix errors #1049 * trying to fix errors take 2 #1049 * trying to fix errors take 3 #1049 * Removed a unnecessary space #1049 * Making all METplus Names CAPITAL LETTERS #1049 * Feature 344 met util refactor (#1292) * removed deprecated sections from config examples * minor change to METplus release guide to add a link to the PDF of the User's Guide instead of downloading it and attaching it to the release * Feature 1285 extract tiles mtd times (#1315) * Feature 896 more met config (#1322) * removed incorrect search keyword * added workflow_dispatch event so workflow can be triggered by an external repository such as MET to test to ensure that changes from that repo will break anything in METplus * added another input argument for workflow_dispatch event * added job with name that shows the event name or the repository name if triggered by an external repository such as MET * GHA: add username that triggered external event to event info job name * added required input argument for external trigger that contains the commit hash of the push event that triggered in the other repo * change event info to show commit hash instead of username that merged the PR * changed input names to match names of event in repository that triggered workflow * feature 1320 OMP_NUM_THREADS (#1338) * Feature 1183 memory documentation (#1340) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * add email address of user who triggered push event to job name * Feature 1166 series analysis field info (#1353) * Feature 1116 usecase smos (#1348) Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * turn off new use case from every push * feature 1236 Control Members in EnsembleStat and GenEnsProd (#1357) * added optional argument to change the directory to untar new input data into so the same Dockerfile can be used to add data for other METplus components such as MET * feature 1358 v4.1.0-beta5 release (#1359) * update version for next development cycle * Feature 1216 usecase smap (#1361) * Adding a conf file for SMAP * Adding a directory to host the read file * Removing temp file * Updated the valid dates to match Todd's code * Adding documentation for SMAP case * Updates the valis dates to match Todd's code * Removing a tmp file * Typo in file name * Updating the input RTOFS to have the init time instead of the valid time ii the file name * updated file paths, tesing * updated use case descriptions, rearranged use case group testing * put new use case into its own group so that the diff logic can evaluate marine_and_cryosphere:3. The truth data for 3-4 does not exist yet so the diff fails. Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * updated marine_and_cryo grouping * Feature 1230 stratosphere metrics (#1354) * Initial checkin for Meridial Mean use case * Changed the name and directories * Added some documentation * Fixed config variables * Issue 1230 Stratospheric metrics (zonal/meridional use case) put INPUT_BASE in the user_env_vars so the user doesn't need to set the INPUT_BASE environment in the current working shell * Issue #1230 remove import of metplotpy-this isn't called * Issue #1230_stratosphere_metric Add use case to the list of use cases to be run for testing * Issue 1230 Remove the INPUT_BASE from the user_env_vars section * Issue #1230 redundant files * Issue #1230 redundant files * Issue #1230 redundant files * Issue #120 replace INPUT_BASE with INPUT_FILE_NAME * Issue #1230 remove entry for INPUT_FILE_NAME, this goes in the system.conf * Update all_use_cases.txt Copy and pasted #11 from s2s use case for the Stratosphere use case but forgot to update the index to 12. * Update use_case_groups.json added use case #12 from s2s to test stratosphere use case * Issue #1230 put INPUT_FILE_NAME back under the user_env_vars * Issue #1230 forgot to include the filename * Issue #1230 clean up config file, remove uneccessary comments, group related entries in the user_env_vars * Issue #1230 remove extraneous and incorrect path to the input_filename setting * Removed pingouin dependency * Issue #1230 another cut and paste error fixed for the Stratosphere use case * Issue #1230 type in name, obs_Only should be obsOnly * Issue #1230 added the metdatadb to the env, code imports metdatadb and may require some of these dependencies * issue #1230 removed pingouin dependency from comment to reduce any confusion * issue #1230 turn off the test for the Stratosphere metrics use case * Added use case image Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> * Corrected spelling of occurrence in two places * Fixed misspelling of occurrence * Found and fixed two more misspellings of occurence * Changed version specific information to by X.Y.Z moved text indicating to click save to the bottom of the list. * Feature 1374 python packages (#1378) * Added documentation about updating spreadsheet of Python requirements * Changed references to master_metplus.py to run_metplus.py * Fixed formatting of section with run_metplus.py commands * Updated text for updating the spreadsheet * Removed a newly added section that wasn't needed Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * feature 1368 PCPCombine use zero accum (#1381) * feature 1369 grid_weight_flag in EnsembleStat (#1379) * Per #1356, change how wrappers create instances of other wrappers to ensure that config settings for the created instance do not change values in METplusConfig used by the rest of the wrappers, ci-run-all-diff * Per #1356, remove config_overrides functionality in favor of using instances -- this prevents the issue where overrides for a given tool affect the global config settings. it also forces the configs to override for an instance to be put into another config section so that it will be available in the final conf, ci-run-all-diff * Per #1356, update documentation to reflect changes * Per #1356, fixed unit test to no longer use deprecated approach to overriding config variables * feature 1247 climatology settings (#1385) * feature 1356 isolate config (#1386) * Feature 675 Continuous Integration Documentation (#1409) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 1382 Filename templates in MODEL (#1414) * Feature 1289 explicit file list (#1387) * Per PR #1387 review, fix typo * Bugfix 1421 EnsembleStat use fcst fields in ens dictionary if ens is unset (#1422) * fixed missing path change for docker file path * removed variables that are not used * Feature 1408 use case ptype (#1425) * adding imagery, config file, updating internal tests * updated lists, auto testing * corrected old reference * Update use_case_groups.json * only trigger testing workflow for pull requests that are going into develop or main_* branches * Feature 1371 blocking wr (#1426) * turn off use cases for push events * Feature 1392 climo_cdf.direct_prob and SeriesAnalysis (#1396) * Changed event triggering rules for documentation workflow so that it will run for pull requests even if no files in the docs directory have changed. A recent pull request passed but develop failed after it was approved because files that were referenced in the use case documentation files had been deleted as part of the PR. * feature 1273 TCGen -edeck and -shape (#1424) * Feature 966 Fix mask.poly logic (#1430) * Feature 1030 total seconds documentation (#1428) Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_WeatherRegime.py * Update UserScript_fcstGFS_obsERA_Blocking.py * Update UserScript_obsERA_obsOnly_Blocking.py * Update UserScript_obsERA_obsOnly_WeatherRegime.py * get branch name in job controls job * replace logic to update input data volumes with call to dtcenter/metplus-action-data-update action * feature 1431 remove obs_prepbufr_map (#1433) * Per #675, added images and updated content * added statsmodel package to metplotpy docker conda environment * Added fcst_file_type to two wrappers (#1437) Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added release notes for tasks that have already been completed for beta6 * updated env var for METplotpy base to match changes made to the METplotpy repository * Updated METplotpy base env var to preemptively match changes from PR dtcenter/METplotpy#197. Once that PR is merged into develop, a test workflow will run that should fix this issue. * removed commented code that is no longer used * update the instructions for updating test input data to ensure volume_mount_directories file is updated in the upcoming version directory, i.e. v4.1, so that the Docker data volumes from the release will be created properly * removed duplicate script * updated script to copy volume_mount_directories file into new METplus version directory * added logic to skip files that are temporary copies of tar files that should not be added to new version directory * updated release guide instructions for creating METplus data directory for next development cycle * Feature 911 tc trackint (#1439) Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * added new use cases that are currently being reviewed to release notes * updated event info in contributor's guide * Feature 626 fix hovmoeller documentation (#1444) * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py replace hovmoeller_diagram.conf with UserScript_obsPrecip_obsOnly_Hovmoeller.conf * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py Removed a typo: UserScript This uses data from... Now: This uses data from... * Update UserScript_obsPrecip_obsOnly_Hovmoeller.py * Modified the PR template to add review of the source issue metadata ci-skip-all * feature_1403_python_components_table (#1446) * creating new METplus Components Python Requirements * adding a return to test * testing use case links * testing use case links #2 * testing use case links #3 * testing use case links #4 * Filling in some use cases * fixing indentation #1403 * fixing indentation #1403 take 2 * fixing indentation #1403 take 3 * cleaning up anything after # in the links #1403 * entries thru D #1403 * entries thru H #1403 * fixing indents #1403 * fixing indents #1403 take 2 * fixing web name #1403 * entries thru L #1403 * entry matplotlib #1403 * entry matplotlib #1403 marking duplicate names * entry metcalcpy #1403 * entry metcalcpy fix indents #1403 * entry matplotlib #1403 fixing duplicate names * entry metplotpy #1403 * entry metplotpy #1403 marking duplicate names * entry metplotpy #1403 fixing * entry thru ps #1403 * double names #1403 * character fix #1403 * adding in missing links #1403 * thru pyproj #1403 * problem with line 353 #1403 * thru pyproj #1403 typos * more duplicate names #1403 * line break #1403 * loose ends #1403 * adding >= to some of the versions #1403 * adding name to the Use Cases to avoid duplicate naming issues TEST #1403 * adding name to the Use Cases to avoid duplicate naming issues thru pyproj #1403 * adding thru pyresample #1403 * fixing pyresample typo #1403 * adding thru scikit-image #1403 * fixing line breaks#1403 * web links thru scikit-learn #1403 * web links thru scipy #1403 * web links thru sklearn #1403 * Duplicate web names. temp. fix #1403 * Duplicate web names fixed #1403 * Duplicate web names fixing #3 #1403 * Duplicate web names fixing #4 #1403 * Duplicate web names fixing #5 #1403 * table end #1403 * table loose ends #1403 * Removed unnecessary comma * table loose ends after pull request #1403 * Minor modifications to METplus Component column * Changed description of pyproj * Added link for last referenced use case * Attempting to fix doc warning Co-authored-by: jprestop <jpresto@ucar.edu> * Feature 1318 usecase aviso (#1440) * Correct small typo. * Update pull_request_template.md * Added files for ReadTheDocs (#864) * Updated documentation links for ReadtheDocs * Update pull_request_template.md Added entry for completion date for pull request review. * Adding python embedding script to read AVISO, RTOFS, HYCOM and OSTIA data * Updated the script - working but only RMSE values match * Adding documentation for the AVISO case * Adding a conf file for the AVISO case * Updates to the codel to include model3, obs, climo3 but also has many extra print statements, netcdf output files which needs to be cleaned * Cleaning up the conf file and adding SAL1L2 to get the model_climo sdev and obs_climo sdev * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Updating the file to fix the standard names and add the model3, climo3 and obs3 * Adding an image to the use case. Image Courtesy: EMC/NOAA website * added to use case list * updated case description * removed merge issues * caught second docs issue * removed other doc merge issues, turned off auto test * more merge comments sneaking in Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> * Revert "Feature 1318 usecase aviso (#1440)" (#1459) This reverts commit d3021de. * Feature 1449 v4.1.0 beta6 (#1461) * Per #1449, updated version as specified in the Release Guide * Per #1449, updated release notes * Updated release date for beta6 release Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * updated version number after beta release * Feature 1318 usecase aviso attempt 2 (#1473) Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu> * error if no input template is set for GridDiag wrapper * added comment for new logic, ci-run-diff * updated old section name to config, ci-run-all-diff * fixed bug with replacing wildcard characters with 'all' in output file paths * Revert "fixed bug with replacing wildcard characters with 'all' in output file paths" This reverts commit c11711e. * fixed bug with replacing wildcard characters with 'all' in output file paths, ci-run-all-diff * feature 1102 -out for TCStat and StatAnalysis (#1477) * feature 1464 EnsembleStat probabilistic additions (#1479) * feature 1445 normalize in GenEnsProd (#1478) * added logic to add quotes around grid value if they are not set in conf variable value, moved error check for unset grid to init step, ci-run-all-diff * bugfix 1486 PB2NC file window variables not read (#1487) * added build arg to override MET DockerHub repository so development version tests can use dtcenter/met-dev:develop * set MET DockerHub repo based on develop or stable version of METplus * run diff logic for push events to develop and main_v* branches so we can catch if changes to external repositories caused differences in the output * do not run diff logic on main_v* and develop branch push events -- diff logic is already running when external repository triggers workflow, which is what we need to test with the diff logic * Added description for Use Cases * updated script to set up new release input data directories -- use real path for all symbolic links for consistency, added usage statement * changed logic to error if new version directory to create already exists at all -- previous logic only errors if directory is not empty * Changed all filename template tags for datetime objects (init/valid/da_init/etc.) to use %H instead of %2H. We discovered that Python 3.6.8 interprets %2H as the same as %H (correctly substituting the hour), however Python 3.8.8 interprets %2H as 2H. The number in between the % and letter is not supported by strftime so it is not valid for these datetime values. The logic to zero-pad using this notation was written in the METplus string substitution logic and only applies to lead and level template tags. ci-run-all-diff * feature 1274 TCGen use case using -shape/-genesis (#1492) Co-authored-by: Kathryn Newman <knewman@seneca.rap.ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> * feature 1490 Python Embedding for Point Observations (#1491) * update use case groupings for automated tests * removed extra comma typo, ci-run-all-diff * added missing characters in commmands * Feature 1403 python components table (#1497) Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> * testing new statistics provided by Tara #1049 * testing new statistics #2 #1049 * New statistics from Tara #1049 * New statistics from Tara small corrections #1049 * New statistics from Tara small corrections #2 #1049 * New statistics from Tara small moving to Diagnostics table #1049 * Fixing space-time, like that's possible #1049 * Fixing spacing #1049 * feature 1471 fix current field info in output_prefix (#1500) * Feature 1503 v4.1.0 rc1 (#1504) * update version after rc1 release to reflect development towards 4.1.0 release * Corrected documentation title name * bugfix 1486 pb2nc window variables (#1507) * feature 1443 document probabilistic field settings (#1508) Co-authored-by: johnhg <johnhg@ucar.edu> * feature 943 document referencing current level (#1509) * feature 1510 v4.1.0 Release (#1511) * updated release guide to reflect updated process to trigger reference branch GHA workflow for an official release * update version to reflect development towards 5.0.0-beta1 release * Feature 673 MET (#1517) * set MET docker repo to dtcenter/met if forcing a specific MET tag to use since that is where the stable release versions are stored on DockerHub * pass variable to tell docker build script that an external workflow triggered the run and use -lite if so to ensure that MET docker image that was created by the triggering MET workflow is used * echo output variables from job control job so they can be reviewed in the GHA log output * minor fix for consistency in logs, ci-skip-all * Feature 1399 usecase cable (#1538) * Adding initial code to read AOML Cable Transport and RTOFS cable transport variables * Updating the conf file (no stat analysis yet) and updates to the read file * Updating the conf file to add STAT_ANALYSIS * Updates to the code- adding stats * Updated code--runs now but needs to follow User Script conventions * Changed directory name based on MET conventions * Updating the read file and adding a conf file * Added logic to count the number of directories in the RTOFS dir * Updated to run with UserScript conf * update version for official release * Adding a yaml file to specify start_date * Added the yaml file and cleaned up the conf file * Added logic to read the yaml file, cleaned up the script * Updating the confile to add output dir, input template and clean up * Removing yaml, getting vDate from conf file, adding output file * Adding the doc file for the cable use case * Adding image courtesy NOAA * Adding more documentation * Adding more info * Updated docs * Correcting the python embedding script * Updating to see if the error goes away..no clue * Fixing the doc error * modifed docs, testing * updated permissions for script * turned off always testing * Updated version number * Update use_case_groups.json * Removed erroneous file * Apply suggestions from code review * Update .github/parm/use_case_groups.json Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update docs/use_cases/model_applications/marine_and_cryosphere/UserScript_fcstRTOFS_obsAOML_calcTransport.py Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> * Update UserScript_fcstGFS_obsERA_WeatherRegime.conf Fixed a title typo * Feature component links (#1518) * Feature 770 3rd person (#1564) * changing from 2nd to 3rd person and fixing some spacing #770 * missed we and corrected #770 * typos, spacing etc #770 * spelling, italics and bolding #770 * removing you changing to 3rd person #770 * changing to 3rd person #770 * 3rd person already done. Fixing formatting, typos etc. #770 * 3rd person already done. Fixing formatting #770 * changing to 3rd person, fixing typos, spacing, etc. #770 * changing to 3rd person, fixing typos, grammar and punctuation. #770 * google doc corrections. #770 * clean up #770 * removing | #770 * typo #770 * Fixing TOC and coding block #770 * fixing note #770 * one 3rd person fix. Updating bolding and italics for file names and directories #770 * Modified Python Code Analyis Tools * Modified Python Code Analyis Tools * Removed link for PROCESS_LIST. If we can't have an internal link, we do not want one in this case. * fixing space #770 * fixing conflict #2 #770 * fixing typos #770 * fixing typos #2 #770 * directory formatting #2 #770 * Changed sub process to subprocess * Modified usage of user because this text is for developers. Made other minor changes. Co-authored-by: Julie Prestopnik <jpresto@ucar.edu> * bugfix 1555 develop clear args properly (#1562) * Fixed bug in classification text file (#1568) Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: TaraJensen <jensen@ucar.edu> Co-authored-by: johnhg <johnhg@ucar.edu> Co-authored-by: Christina Kalb <kalb@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: Julie Prestopnik <jpresto@seneca.rap.ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: Mrinal Biswas <biswas@ucar.edu> Co-authored-by: j-opatz <jopatz@ucar.edu> Co-authored-by: bikegeek <minnawin@ucar.edu> Co-authored-by: Hank Fisher <fisherh@ucar.edu> Co-authored-by: Hank Fisher <fisherh@kiowa.rap.ucar.edu> Co-authored-by: Minna Win <minnawin@kiowa.rap.ucar.edu> Co-authored-by: bikegeek <3753118+bikegeek@users.noreply.github.com> Co-authored-by: Christina Kalb <kalb@kiowa.rap.ucar.edu> Co-authored-by: Hank Fisher <fisherh@seneca.rap.ucar.edu> Co-authored-by: Mrinal Biswas <biswas@seneca.rap.ucar.edu> Co-authored-by: Kathryn Newman <knewman@seneca.rap.ucar.edu>

georgemccabe added type: bug Fix something that is not working component: documentation Documentation issue priority: blocker Blocker alert: NEED ACCOUNT KEY Need to assign an account key to this issue requestor: METplus Team METplus Development Team labels Aug 5, 2021

georgemccabe added this to the METplus-4.0.1 Bugfix milestone Aug 5, 2021

georgemccabe assigned hankenstein2 Aug 5, 2021

hankenstein2 closed this as completed Aug 24, 2021

jprestop reopened this Sep 9, 2021

jprestop modified the milestones: METplus-4.0.1 Bugfix, METplus-4.1.0 Sep 9, 2021

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, modified installation instructions and system configuratio…

96a13a7

…n to point to installation instructions for MET

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, modified installation instructions and system configuratio…

6b68ab1

…n to point to installation instructions for MET

This was linked to pull requests Sep 14, 2021

feature 1067 main_v4.0 install instruct #1155

Merged

feature 1067 develop install instruct #1156

Merged

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, chnage dashes to asterisks in lists

e043d29

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, removed dashes

69b121d

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, trying to figure out why the asterisk list isn't working

fe7a6d1

jprestop pushed a commit that referenced this issue Sep 14, 2021

Per #1067, trying to fix list problem

eb21b4a

georgemccabe closed this as completed in #1155 Sep 15, 2021

jprestop pushed a commit that referenced this issue Sep 17, 2021

Per #1067, working on attempts to have multiple glossaries with the s…

f9fd1da

…ame term

jprestop pushed a commit that referenced this issue Sep 17, 2021

Per #1067, working on attempts to have multiple glossaries with the s…

cd8afca

…ame term

jprestop pushed a commit that referenced this issue Sep 17, 2021

Per #1067, working on attempts to have multiple glossaries with the s…

f3df342

…ame term

jprestop pushed a commit that referenced this issue Sep 17, 2021

Per #1067, removing code with attempts at mutiple glossaries

b419916

jprestop pushed a commit that referenced this issue Sep 17, 2021

Per #1067, adding back three question marks due to duplicate term

9b86f04

JohnHalleyGotway assigned jprestop and georgemccabe Sep 23, 2021

JohnHalleyGotway removed the alert: NEED ACCOUNT KEY Need to assign an account key to this issue label Sep 23, 2021

TaraJensen added the reporting: DTC NOAA BASE NOAA Office of Atmospheric Research DTC Project label Oct 1, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix installation instructions in User's Guide #1067

Fix installation instructions in User's Guide #1067

georgemccabe commented Aug 5, 2021

hankenstein2 commented Aug 24, 2021

jprestop commented Sep 9, 2021

jprestop commented Sep 14, 2021

Fix installation instructions in User's Guide #1067

Fix installation instructions in User's Guide #1067

Comments

georgemccabe commented Aug 5, 2021

Describe the Problem

Relevant Deadlines

Funding Source

Define the Metadata

Assignee

Labels

Projects and Milestone

Define Related Issue(s)

Bugfix Checklist

hankenstein2 commented Aug 24, 2021

jprestop commented Sep 9, 2021

jprestop commented Sep 14, 2021