You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We would like to set up performance benchmarking in CI using touchstone, consistent with the other epinowcast org packages
Preferred solution
This will require writing actual package functions and comparing to some baseline performance, as in the example here from primarycensoreddist. This will take some more thought but could be something as simple as scoring a nowcast from the package and comparing it to a naive multiplicative factor nowcast that assumes some set delay distribution.
Alternatives
We could also do this with a vignette, similar to the synthetic_validation workflow in EpiNow2 but its probably better to use CI for at least some simple functions and consider a more complicated workflow for a vignette.
The text was updated successfully, but these errors were encountered:
Feature
We would like to set up performance benchmarking in CI using touchstone, consistent with the other
epinowcast
org packagesPreferred solution
This will require writing actual package functions and comparing to some baseline performance, as in the example here from
primarycensoreddist
. This will take some more thought but could be something as simple as scoring a nowcast from the package and comparing it to a naive multiplicative factor nowcast that assumes some set delay distribution.Alternatives
We could also do this with a vignette, similar to the synthetic_validation workflow in
EpiNow2
but its probably better to use CI for at least some simple functions and consider a more complicated workflow for a vignette.The text was updated successfully, but these errors were encountered: