Releases: CODAIT/spark-bench
Releases · CODAIT/spark-bench
v51
v47
v46: Variety of fixes to README
- Fix references to ecurtin/spark-bench - More info on setting environment variables - updating instructions for examples
v43: Updating custom workload docs
The old document referenced an old API. This rewrite focuses on the example from ecurtin/spark-bench-custom-workload.
v42
v41: Updates to examples and documents
Adds the csv-vs-parquet config file to examples and docs Adds page for workload-suite documentation Adds pages for examples
v38: Passing config string instead of temp file
When launching spark-bench through assembled spark-submit scripts, the child argument used to be a path to a temporary file created by the launch process. This was causing issues when running in cluster mode because the temporary files were in local storage. Now instead the configuration is passed as one long string instead of a path to a temporary file.
v36
v35
v34: Fixes spark-home param, updates docs accordingly
This commit fixes a bug in which spark-home was not being picked up from the configuration file, forcing users to set the environment variable SPARK_HOME. The docs are also updated to include a guide to the parameters in spark-submit-config, including spark-home.