Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce memory usage and calculate statistics online/incrementally #103

Merged
merged 5 commits into from
Jul 29, 2018
Merged

Reduce memory usage and calculate statistics online/incrementally #103

merged 5 commits into from
Jul 29, 2018

Commits on Jul 29, 2018

  1. Calculate statistics incrementally 

    This avoids keeping all data points in memory, and should not have any drawbacks for ReBench’s functionality.

However, this also removes the scipy/numpy usage, and all mentioning of medians.

For support of quartile/median reporting to codespeed, we’d need to keep the datapoints, at least temporarily.
Though, I would really prefer to safe them all in codespeed.

Signed-off-by: Stefan Marr <git@stefan-marr.de>
    @smarr
    smarr committed Jul 29, 2018
    Configuration menu
    Copy the full SHA
    10f3950 View commit details
    Browse the repository at this point in the history

  2. Combine loading and filtering of run data 

    This avoids a second path over the data, and avoids keeping the data points around indefinitely.

Signed-off-by: Stefan Marr <git@stefan-marr.de>
    @smarr
    smarr committed Jul 29, 2018
    Configuration menu
    Copy the full SHA
    a684c3a View commit details
    Browse the repository at this point in the history

  3. Do not keep data points in memory anymore 

    Signed-off-by: Stefan Marr <git@stefan-marr.de>
    @smarr
    smarr committed Jul 29, 2018
    Configuration menu
    Copy the full SHA
    27dd6f8 View commit details
    Browse the repository at this point in the history

  4. Added support for capturing data points for testing 

    Signed-off-by: Stefan Marr <git@stefan-marr.de>
    @smarr
    smarr committed Jul 29, 2018
    Configuration menu
    Copy the full SHA
    8b57299 View commit details
    Browse the repository at this point in the history

  5. Simplify construction of run command line 

    This is an attempt to optimize, but I think it also makes the code less convoluted.

Signed-off-by: Stefan Marr <git@stefan-marr.de>
    @smarr
    smarr committed Jul 29, 2018
    Configuration menu
    Copy the full SHA
    20c48b6 View commit details
    Browse the repository at this point in the history