Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement a way to calculate deviation of measurements. #39

Open
qnikst opened this issue Sep 5, 2017 · 2 comments
Open

Implement a way to calculate deviation of measurements. #39

qnikst opened this issue Sep 5, 2017 · 2 comments

Comments

@qnikst
Copy link
Contributor

qnikst commented Sep 5, 2017

Currently hyperion returns only raw measurement data and without external tool it's hard to make sense of data because we don't know how accurate those measurements were. It would be nice if we can measure deviation of the measurements.

@mboes
Copy link
Member

mboes commented Sep 5, 2017

Issue not actionable as it stands. "Deviation of the measurements" - do you mean variance? Which quantitative measures (moments) specifically do you want to see?

@qnikst
Copy link
Contributor Author

qnikst commented Sep 5, 2017

Yes I mean variance, if hyperion is run without --raw flag then it's not possible to understand variance, of the values from report:

{"cycles":null
,"measurements":null
,"garbage_collections":null
,"time_in_nanos":839.5436263736264
,"bench_name":"944"
,"alloc":null,"bench_params":[]}],"metadata":{"location":null,"timestamp":"2017-09-05T11:47:47.633059736Z"}}

P.S. In case of the --raw flag there is enough information in order to implement that test in 3rd party application, but for human readable report this information is missing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants