Update develop-ref after #2050 #2053
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com>
* moved logic to handle climo_mean/stdev dictionaries into met_config utility * moved constant variable to constants and made name uppercase * per #1599, added logic to read VAR<n> variables for climo_mean/stdev (i.e. GRID_STAT_CLIMO_MEAN_VAR1_NAME). Added function to easily format field info for a single field or list of fields with fewer arguments * added function to format field info that is easier to call than get_field_info and can eventually replace it * added line breaks to match pep8 standards, ci-run-all-diff * per 1599, added documentation for new config variables * replaced calls to get_field_info with format_field_info since it is much simpler * fixed bug where field list is never returned from function call * removed whitespace * modified logic to report an error if no commands were run at all * only report an error if the process list contains a wrapper that should generate at least 1 command. Example and CyclonePlotter wrappers do not run any shell commands, so they are excluded * per feedback in PR #1658 review, added glossary entry that is wrapper independent and provide reference to that entry instead of duplicating information for each wrapper * per #1653, add unit tests to check that day_interval value of climo_mean/stdev dictionary can be NA or an integer * per #1653, modified function to read climo variables to support NA instead of just integers * per #1653, updated unit tests to test both climo_mean and climo_stdev variables, added tests for all other climo variables
…er/met-dev if the tag is develop, otherwise use dtcenter/met
…. After restructuring the repo, remove the 'met/' prefix from some paths. Also, remove the attach_release_tarfile.rst instructions since that step is no longer required. Technically, its still needed for version 10 bugfix releases, but just removing it now is simpler.
… release was created
* added documentation * added pic, config file, more documentation * modified config file, added to internal tests * attempt to correct docs error * added new tool-specific probability feature * Updated run option in json file
* first pass at documentation, config, and python scripts * 2nd addition of files to use case * updated config file for dir path * Update use_case_groups.json * Removed unused config options
…or METdataio (renamed from METdatadb) to use in automated tests
* changing from 2nd to 3rd person and fixing some spacing #770 * missed we and corrected #770 * typos, spacing etc #770 * spelling, italics and bolding #770 * removing you changing to 3rd person #770 * changing to 3rd person #770 * 3rd person already done. Fixing formatting, typos etc. #770 * 3rd person already done. Fixing formatting #770 * changing to 3rd person, fixing typos, spacing, etc. #770 * changing to 3rd person, fixing typos, grammar and punctuation. #770 * google doc corrections. #770 * clean up #770 * removing | #770 * typo #770 * Fixing TOC and coding block #770 * fixing note #770 * one 3rd person fix. Updating bolding and italics for file names and directories #770 * Modified Python Code Analyis Tools * Modified Python Code Analyis Tools * Removed link for PROCESS_LIST. If we can't have an internal link, we do not want one in this case. * fixing space #770 * fixing conflict #2 #770 * fixing typos #770 * fixing typos #2 #770 * directory formatting #2 #770 * Changed sub process to subprocess * Modified usage of user because this text is for developers. Made other minor changes. * first attempt at grammar, bolding, italics and period clean up #770 * under 79 characters #770 * changing to 3rd person #770 * fixing typos #770 * 3rd person and typos #770 * fixing formatting #770 * typo cleanup #770 * more typo cleanup #770 * adding periods to most bullet lists #770 * adding periods to most bullet lists #770 * changing web address to italics instead of bold, not linking because it is an example. * creating links attempt. * creating links attempt #2. * creating links attempt #3. * fixing typo for add_use_categories * removing warning block per George M. * changing sentence * no screenshots to be added * adding note box * fixing bolding * Made some minor tweaks Co-authored-by: Julie Prestopnik <jpresto@ucar.edu>
* per #685, added custom pytest markers for many tests so we can run groups of tests in automation to speed things up. removed unused imports from tests and removed parenthesis from assert statements when they are not needed * per #685, change logic to check if test category is not equal to 'pytest' to does not start with 'pytest' to allow groups of pytests * per #685, run pytests with markers to subset tests into groups * fixed check if string starts with pytests * added missing pytest marker name * added logic to support running all pytests that do not match a given marker with the 'not <marker>' syntax * change pytest group to wrapper because the test expects another test to have run prior to running * fix 'not' logic by adding quotation marks around value * another approach to fixing not functionality for tests * added util marker to more tests * fixed typo in not logic * added util marker to more tests again * fixed logic to split string * marked rest of util tests with util marker * fixed another typo in string splitting logic * tested change that should properly split strings * moved wrapper tests into wrapper directory * changed marker for plotting tests * added plotting marker * improved logic for removing underscore after 'not' and around 'or' to specify more complex marker strings * test running group of 3 markers * fixed path the broke when test file was moved into a lower directory * Changed StatAnalysis tests to use plotting marker because some of the tests involve plotting but the other StatAnalysis tests produce output that are used in the plotting tests * changed some tests from marker 'wrapper' to 'wrapper_a' to split up some of these tests into separate runs * test to see if running pytests in single job but split into groups by marker will improve the timing enough * fixed typos in new logic * removed code that is no longer needed (added comment in issue #685 if this logic is desired in the future) * per #685, divided pytests into smaller groups * added a test that will fail to test that the entire pytest job will fail as expected * add error message if any pytests failed to help reviewer search for failed tests * removed failing test after confirming that entire pytest job properly reports an error if any test fails * turn on single use case group to make sure logic to build matrix of test jobs to run still works as expected * turn off use case after confirming tests were created properly * added documentation to contributor's guide to describe changes to unit test logic * added note about adding new pytest markers
* Per #1402, added additional comments to config file including links to documentation. Added old format version of config file that contain many comments with the _DIR/_TEMPLATE variables grouped together for comparison * rearrange variables and added link to user's guide * updated comment to note that variables in the section are optional * added URL for use case documentation * per #1402, rearrange and clean up config file * added missing config variables from CyclonePlotter to glossary and wrappers doc pages * per #1402, clean up use case conf files, ci-run-all-diff * per #1402, clean up Point2Grid conf file * per #1402, clean up rest of met_tool_wrapper use case conf files, ci-run-all-diff * removed conf file that is no longer needed
…ata_assimilation
Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com>
…s in case server is down
… number of DockerHub tag pages to search to 15
…e data for next version directory
…cial MET releases.
…geovista code will be added directly to python instead of reading it from the source code location, ci-skip-all
…ment instead of the PyEmbedIngest environment
…an10 and Python 3.10.4 (#2043)
…will contain use case category to more easily see which case was run
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Automated test environment changed to use Debian 10 and Python 3.10.4 which produced small rounding differences. Also, directory structure modified to include use case category to more easily review error logs
Created by @georgemccabe