Automated performance testing

Overview

This page explains how to get started using ansible to setup a RiakCS cluster and automated performance testing.

The goal is to have a suite of performance tests that can be run on any set of hardware or VMs with mimimal effort and time. Currently, the only supported operating system variants are Ubuntu 12.04 and Centos 6.

Prerequisites

1. Install ansible
2. Clone the ansible-riak-benchmarking repo. The repo uses the git-flow branching model so use master for a stable snapshot or develop for more bleeding edge changes.

Setup

Follow the documentation here for setting up a Riak CS cluster for testing.

Testing

Follow the documentation here to start running tests.

Available Tests

WARNING Currently, this is WIP list of tests that need to be created.

Question Should we also include worker concurrency as a variable or for a first pass is just getting this set of tests using a constant level of concurrency sufficient?

Read tests

• riakcs_read-100KB-1hr
• riakcs_read-1MB-1hr
• riakcs_read-1GB-1hr
• riakcs_read-100KB-3hr
• riakcs_read-1MB-3hr
• riakcs_read-1GB-3hr
• riakcs_read-100KB-6hr
• riakcs_read-1MB-6hr
• riakcs_read-1GB-6hr

Write tests

• riakcs_write-100KB-1hr
• riakcs_write-1MB-1hr
• riakcs_write-1GB-1hr
• riakcs_write-100KB-3hr
• riakcs_write-1MB-3hr
• riakcs_write-1GB-3hr
• riakcs_write-100KB-6hr
• riakcs_write-1MB-6hr
• riakcs_write-1GB-6hr

Mixed operation tests

• riakcs_read-write-100KB-1hr
• riakcs_read-write-1MB-1hr
• riakcs_read-write-1GB-1hr
• riakcs_read-write-100KB-3hr
• riakcs_read-write-1MB-3hr
• riakcs_read-write-1GB-3hr
• riakcs_read-write-100KB-6hr
• riakcs_read-write-1MB-6hr
• riakcs_read-write-1GB-6hr
• riakcs_read-write-delete-100KB-1hr
• riakcs_read-write-delete-1MB-1hr
• riakcs_read-write-delete-1GB-1hr
• riakcs_read-write-delete-100KB-3hr
• riakcs_read-write-delete-1MB-3hr
• riakcs_read-write-delete-1GB-3hr
• riakcs_read-write-delete-100KB-6hr
• riakcs_read-write-delete-1MB-6hr
• riakcs_read-write-delete-1GB-6hr

Object listing performance tests

• riakcs_list_objects_1M
• riakcs_list_objects_5M
• riakcs_list_objects_10M

Multipart upload performance tests

• riakcs_mp_upload_10GB
• riakcs_mp_upload_100GB
• riakcs_mp_upload_1TB
• riakcs_mp_upload_5TB