You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A way to harden the package against misspecified inputs is by calling all functions with a variety of given inputs and record the failures. Rather than concentrating on a large number of random inputs, for our needs at this stage it's sufficient to just test our large number of functions on the same inputs to reveal lacks in our input validation or elsewhere.
This takes advantage of the fact that when we have handled an error, we report the function name in the error message. So by ignoring those errors, we are left with the unhandled errors. These are effectively already unit tests that could be added to our test suite.
This is meant as a tracking bug for this work.
The text was updated successfully, but these errors were encountered:
A way to harden the package against misspecified inputs is by calling all functions with a variety of given inputs and record the failures. Rather than concentrating on a large number of random inputs, for our needs at this stage it's sufficient to just test our large number of functions on the same inputs to reveal lacks in our input validation or elsewhere.
I've written this simple package, to implement this: https://mcol.github.io/caught-by-the-fuzz/
This takes advantage of the fact that when we have handled an error, we report the function name in the error message. So by ignoring those errors, we are left with the unhandled errors. These are effectively already unit tests that could be added to our test suite.
This is meant as a tracking bug for this work.
The text was updated successfully, but these errors were encountered: