Skip to content

jhlegarreta/ITKPerformancePlot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

93 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ITKPerformancePlot

https://img.shields.io/badge/License-Apache%202.0-blue.svg?style=shield

Overview

A module to plot ITK performance benchmarking data.

Data

Three dataset are provided for the purpose of demonstrating the visualization capabilities of the module:

Note that the JSON files in the simplified_data.tar.gz and the scatter_os_data.tar.gz were manually edited from the original clay benchmarking files hosted in the data.kitware.com to simulate benchmarks for ITK versions that were not present in the original clay dataset, as well as to give rise to some situations (e.g. modules not present in some ITK versions, different number of time probes across modules or versions, etc.) that could potentially arise when benchmarking ITK modules across time. Thus, they may not reflect actual ITK module performances.

The visualization scripts were tested on all three datasets using Python 3.6.5.

Usage

Please follow the steps described:

  1. Clone the repository.

  2. Install Python.

  3. Install the requirements using the requirements.txt file provided.

  4. Run the example visualization program on the input dataset by providing the folder where the (uncompressed) benchmarking JSON files are located, and provide a filename for the JSON summary, e.g.:

    python ./examples/itk_performance_benchmarking.py ./example_data/clay ./output/summary.json
    

Example visualizations

These example visualizations were created using the JSON files contained in the scatter_os_data.tar.gz example dataset.

Module error bar plot:

results/ITK_PerformanceBenchmarking-Module_vs_ITK_version_errorbar_LevelSet.png

Module scatter plot:

results/ITK_PerformanceBenchmarking-Module_vs_ITK_version_OS_scatterplot_LevelSet.png

Historical heatmap:

results/ITK_PerformanceBenchmarking-Historical_heatmap.png

License

This software is distributed under the Apache 2.0 license. Please see the LICENSE file for details.

About

ITK performance plots

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published