METplus Coordinated 6.1.0-beta1 Testing

[bikegeek]

Listed below are summaries of the new features, enhancements, and bugfixes included in all development cycles (beta1, beta2, and release candidate 1) for each software component of the METplus Coordinated 5.1.0 release. These tables summarize the status of external acceptance testing.

Note that status of earlier testing for METplus Coordinated 5.1.0-beta1 Testing and METplus Coordinated 5.1.0-beta2 Testing has been copied into this discussion.

Please see the METplus 5.1 Existing Builds page to see where the release candidate versions are already installed.

Instructions

For each line in these tables, the Tester listed should test the release candidate to confirm the changes work as expected in their environment.

• For Integration Testing (not specifically tied to a single GitHub issue):
  • ON THIS DISCUSSION: Add a comment to document the testing outcome using the template provided below.
• For Repository Testing (new features, enhancements, and bugfixes):
  • ON THE ISSUE ITSELF: Document their testing with a comment using the template provided below.
  • ON THIS DISCUSSION: Add a comment linking to their issue comment created above.

Copy/paste the following template into your issue or discussion comment:

<h3>Release Acceptance Testing Summary</h3>

Version: METplus-5.1.0-rc1
Date:
Location:
Status (PASS/FAIL):
Description:

The Tester is set to NA for any issues that do not require external acceptance testing.

Integration Testing

Integration Testing refers to testing functionality not specifically tied to a single GitHub issue. The largest category here is testing existing use cases in your environment (e.g. NOAA/EMC testing their EMC Vx System use cases). This also includes testing new features across multiple METplus components.

Users are encouraged to test their existing use cases with the METplus release candidate and report their results as comments on this discussion (see Instructions above). Please indicate the name of the use case if not already listed in the table below. Comments about expected results (PASS) and unexpected results (FAIL) are welcome. The METplus team will add a row for the use case and summarize those comments in the table below.

Status (OPEN, PASS, FAIL)	Description	Tester	Acceptance Testing Comment Link
OPEN	Test compilation of MET-11.1.0-RC1 with Clang
PASS	Test SWPC-RT Use Cases with RC1	@jvigh	#2218 (comment)
UNKNOWN	Test METplus TCDiag wrapper with MET TC-Diag tool	@jvigh	#2218 (comment)
OPEN	Test METplus MODE wrapper with Multi-Variate MODE enhancements	@hertneky
OPEN	Test EMC Vx System use cases	@AliciaBentley-NOAA
PASS	EVS components global_det atmos and wave stat	@malloryprow	#2218 (comment)
PASS	EVSv1 subseasonal component	@ShannonShields-NOAA	#2218 (comment)
PASS	EVS testing for TC component	@OliviaOstwald-NOAA	#2218 (comment)
PASS	EVS parallel tests were successful for CAM/precip and /grid2obs verification	@MarcelCaron-NOAA	#2218 (comment)
PASS	EVS parallel tests were successful for mesoscale/grid2obs, precip and snowfall verification	@RoshanShrestha-NOAA	#2218 (comment)
FAIL	ASCII2NC with python embedding failed to convert Argo profile data into a netCDF file	@GwenChen-NOAA	#2218 (comment)
	User testing results from comments on this discussion

Repository Testing: METplus Wrappers (Project Board)

Testing of specific METplus Wrapper issues (new features, enhancements, and bugfixes).

Status (OPEN, PASS, FAIL)	METplus Issue	Dev Cycle	Tester	Acceptance Testing Comment Link

The majority of the changes to METplus wrappers were tested when the changes were made, so testing of these specific issues may not be necessary. However, it would be good to perform general testing of existing METplus use cases to ensure that any changes have not caused unexpected bugs. This should be covered in the "Integrated Testing" section.

Repository Testing: MET (Project Board)

Testing of specific MET issues (new features, enhancements, and bugfixes).

Status (OPEN, PASS, FAIL)	MET Issue	Dev Cycle	Tester	Acceptance Testing Comment Link

Repository Testing: METplus Analysis (Project Board)

Testing of specific METplus Analysis (METdataio, METcalcpy, METplotpy, METviewer, and METexpress) issues (new features, enhancements, and bugfixes).

Status (OPEN, PASS, FAIL)	METdataio Issue	Dev Cycle	Tester	Acceptance Testing Comment Link
PASS	dtcenter/METdataio#348	beta1	@jpresto

Status (OPEN, PASS, FAIL)	METcalcpy Issue	Dev Cycle	Tester	Acceptance Testing Comment Link
PASS	dtcenter/METcalcpy#414	beta1	@bikegeek
PASS	dtcenter/METcalcpy#415	beta1	@bikegeek
PASS	dtcenter/METcalcpy#417	beta1	@bikegeek

Status (OPEN, PASS, FAIL)	METplotpy Issue	Dev Cycle	Tester	Acceptance Testing Comment Link

Status (OPEN, PASS, FAIL)	METviewer Issue	Dev Cycle	Tester	Acceptance Testing Comment Link
	No testing required for any issues

Status (OPEN, PASS, FAIL)	METexpress Issue	Dev Cycle	Tester	Acceptance Testing Comment Link
	No testing required for any issues