Skip to content
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.

add correctness data and class size unit test metrics - facilitates certainty in correct data flow #317

Closed
maxkazmsft opened this issue May 26, 2020 · 1 comment · Fixed by #375
Closed

add correctness data and class size unit test metrics - facilitates certainty in correct data flow #317

maxkazmsft opened this issue May 26, 2020 · 1 comment · Fixed by #375
Assignees
@fazamani
Labels
Prior: High Type: Enhancement This an enhancement to an existing feature
Milestone
V0.2 [June release]

Comments

@maxkazmsft
Copy link
Contributor

maxkazmsft commented May 26, 2020 •
edited
Loading

add performance metrics similar to test/cicd/src/check_performance.py to check whether the input data and predicted results on synthetic checkerboard dataset have the correct dimensions, etc - this essentially checks the correctness of data flow through the project

Checking data sizes only - not distributions

  • number of classes - training, prediction
  • length of dataset
  • length of data loader

Pre-requisit #346
@maxkazmsft maxkazmsft added this to the V0.1.3 [BYOD] milestone May 26, 2020
@maxkazmsft maxkazmsft added Prior: High Type: Correctness anything to do with repo being technically correct labels May 26, 2020
@maxkazmsft maxkazmsft self-assigned this May 28, 2020
@maxkazmsft maxkazmsft modified the milestones: V0.1.3, V0.1.4 Jun 5, 2020
@maxkazmsft maxkazmsft added Type: Enhancement This an enhancement to an existing feature and removed Type: Correctness anything to do with repo being technically correct labels Jun 5, 2020
@maxkazmsft maxkazmsft assigned fazamani and unassigned maxkazmsft Jun 7, 2020
@fazamani
Copy link
Collaborator

add a test to check the bounds (limits) on the data

@fazamani fazamani mentioned this issue Jun 18, 2020
Merged
@fazamani fazamani linked a pull request Jun 18, 2020 that will close this issue
Data flow tests #375
Merged
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@fazamani fazamani

Labels
Prior: High Type: Enhancement This an enhancement to an existing feature
Projects
None yet
Milestone
V0.2 [June release]
Development

Successfully merging a pull request may close this issue.

Data flow tests microsoft/seismic-deeplearning
2 participants
@maxkazmsft @fazamani