To run benchmarks on the GraalVM, please download a copy from the Oracle Technology Network:
http://www.oracle.com/technetwork/oracle-labs/program-languages/overview/index.html
We tested with http://download.oracle.com/otn/utilities_drivers/oracle-labs/graalvm-0.24-linux-x86_64-dk.tar.gz and http://download.oracle.com/otn/utilities_drivers/oracle-labs/graalvm-0.24-macosx-x86_64-dk.tar.gz
Extract the GraalVM into a folder, and set the GRAALVM_HOME environment.
GRAALVM_HOME should point to the folder that contains bin/java