First version performance tests

[ejemba]

The first version of the performance tests script.
It contains the trunk to handle a remote openshift server
It handles :

• proxy
• certificates
• public dns name

it only has been tested on aws. Since it is vagrant-openshift based it can be used with any provider.
The goal is that this script can also be used by third parties in their build.

It will execute the performance tests according the options chosen via flags
Without flag it will follow the workflow below:

1. build openshift client on localhost
2. build and start the remote instance
3. run the performance tests
4. terminate the instances

Now this working fine. Next step will be formalization of tests themselves and the tests outputs so it can be handled properly by jenkins.
After this I will add the first tests including basic but fair high number of cluster and analyse.

[danmcp]

@ejemba I would rather this not be tied to vagrant at all. This script should be something that you can run against any openshift install. And have it be a separate exercise to launch and instance and kick off the tests against it.

What I was looking for was more the tests. Not the orchestration of setting up an instance and tearing it down.

[ejemba]

@danmcp regarding vagrant dependencies, in our discussion, I clearly understood vagrant-plugin was the way to provision the VM, because it encapsulates various provider, various, os etc. I myself wouldn't have started with it.
How can we replace vagrant, and keeping the multi provider aspect (aws,openstack,libvirt,virtualbox) ?
I needed the orchestration script to create the tests themselves, now I can add the tests.
But the PR can be represented when at least the firsts tests will be included.

[danmcp]

@ejemba I am just looking for a separation of concerns. Having a script to run performance tests and having a script to launch an environment are two separate things. I don't know that we really need the separate script to launch the environment. We would normally just do that from jenkins or similar. Or in more complex cases you might build up an environment using openshift-ansible. The logic I do really want is a series of test cases that stress the performance of different aspects of the system.