We have added new terraform VDBench examples for a more automatic install:
The below instructions will still work, if you do not wish to use the Terraform examples.
This is a basic setup to generate small and medium sized workloads to test the Azure HPC Cache or Avere vFXT for Azure memory and disk subsystems. The suggested configuration is 12 x Standard_D2s_v3 clients for each group of 3 vFXT nodes or for each 2 GB/s of throughput capacity in an HPC cache.
vdbench download and documentation
These deployment instructions describe the installation of all components required to run Vdbench:
-
Deploy an Azure HPC Cache or Avere vFXT for Azure.
-
If you have not already done so, ssh to the controller, and mount to the addresses of the HPC cache or Avere vFXT:
-
Run the following commands:
sudo -s apt-get update apt-get install nfs-common mkdir -p /nfs/node0 mkdir -p /nfs/node1 mkdir -p /nfs/node2 chown nobody:nogroup /nfs/node0 chown nobody:nogroup /nfs/node1 chown nobody:nogroup /nfs/node2
-
Edit
/etc/fstab
to add the following lines but using your HPC cache or vFXT node IP addresses. Add more lines if your cluster has more than three nodes.10.0.0.12:/msazure /nfs/node0 nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0 10.0.0.13:/msazure /nfs/node1 nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0 10.0.0.14:/msazure /nfs/node2 nfs hard,nointr,proto=tcp,mountproto=tcp,retry=30 0 0
-
To mount all shares, type
mount -a
-
-
On the controller, download the vdbench bootstrap script:
mkdir -p /nfs/node0/bootstrap cd /nfs/node0/bootstrap curl --retry 5 --retry-delay 5 -o /nfs/node0/bootstrap/bootstrap.vdbench.sh https://raw.githubusercontent.com/Azure/Avere/master/src/clientapps/vdbench/bootstrap.vdbench.sh
-
Download the latest vdbench from https://www.oracle.com/technetwork/server-storage/vdbench-downloads-1901681.html, and scp the zip file to the
/nfs/node0/bootstrap
directory. To download you will need to create an account with Oracle and accept the license. -
From your controller, verify your vdbench setup by running the following script. If the script shows success, you are ready to deploy. Otherwise you will need to fix each error listed.
curl -o- https://raw.githubusercontent.com/Azure/Avere/master/src/clientapps/vdbench/vdbenchVerify.sh | bash
-
Deploy the clients by clicking the "Deploy to Azure" button below, but set the following settings:
-
After deployment is complete, find the IP of one of the VDBench clients from the portal or https://resources.azure.com, and login from the controller and run the following commands to set your private SSH secret:
touch ~/.ssh/id_rsa chmod 600 ~/.ssh/id_rsa vi ~/.ssh/id_rsa
-
During installation,
copy_dirsa.sh
was installed to~/.
on the vdbench client machine, to enable easy copying of your private key to all vdbench clients. Run~/copy_idrsa.sh
to copy your private key to all vdbench clients, and to add all clients to the "known hosts" list. (Note if your ssh key requires a passphrase, some extra steps are needed to make this work. Consider creating a key that does not require a passphrase for ease of use.)
-
To run the memory test (approximately 20 minutes), issue the following command:
cd ./run_vdbench.sh inmem.conf uniquestring1
-
Browse to the Azure HPC Cache resource in the portal or log in to Avere vFXT cluster GUI (Avere Control Panel - instructions here) to watch the performance metrics. You will see a similar performance chart to the following:
-
To run the on-disk test (approximately 40 minutes) issue the following command:
cd ./run_vdbench.sh ondisk.conf uniquestring2
-
Log in to the Avere Control Panel (instructions) to watch the performance metrics. You will see a performance chart similar to the following one: