v0.2.1
v0.2.1 has a series of improvements to help us understand Scaler's data
v0.2.1 contains a newly implemented benchmarktoolkit. The benchmarktoolkit supports automated experiments, automated artifact collection, benchmarking with multiple machines, file integrity checks, and provides a unified, easily expandable interface to run parsec and real applications together. Currently, the benchmark enables us to test: Parsec, httpd, nginx, memcachd, redis, mysql, postgresql. Scaler currently reports performance results on all those applications except postgresql as it seems to have some issues caused by multi-process. We identified the benchmark machine has CPU errors and disk errors. The postgresql problem is probably not Scaler's problem.
v0.2.1 also has a series of new python scripts to help interpret benchmark results better.
v0.2.1 removed the support of the previous Fine-Grained-Dynamic-Sampling (FGDS) method. The main problem is we cannot justify that FGDS won't impact the correctness of the result. Some details can be seen in #85.