Skip to content

Commit

Permalink
[config] Add and document other config variables.
Browse files Browse the repository at this point in the history
  • Loading branch information
ingomueller-net committed Apr 29, 2022
1 parent ff00a38 commit 7a88e4f
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion experiments/common/config.sh.template
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,16 @@ S3_REGION="" # The S3 region; e.g. "eu-central-1"
S3_INPUT_BUCKET="" # The S3 bucket name where datasets are stored without the 's3://' prefix; e.g. "my-new-bucket"
S3_INPUT_PATH=s3://${S3_INPUT_BUCKET}/ # The full path within the bucket where the data is stored; e.g. s3://my-new-bucket/path/to/folder

# Create a user with read-only access to S3 or just the bucket above and
# create an access key for that user as described in this guide:
# https://aws.amazon.com/premiumsupport/knowledge-center/create-access-key/
# Then paste the key components into the variables below. This is required only
# by the experiments with RDataFrames.
S3_SECRET_KEY='...'
S3_ACCESS_KEY='...'

# GCP specific values
GS_REGION="" # The GCS region; e.g. "europe-west4-a"
GS_INPUT_BUCKET="" # The GCS bucket name where datasets are stored without the 'gs://' prefix; e.g. "my-new-bucket"
GS_INPUT_PATH=gs://${GS_INPUT_BUCKET}/ # The full path within the bucket where the data is stored; e.g. gs://my-new-bucket/path/to/folder
GS_INPUT_PATH=gs://${GS_INPUT_BUCKET}/ # The full path within the bucket where the data is stored; e.g. gs://my-new-bucket/path/to/folder
GS_DATASET_ID='iris_hep_benchmark_data' # "namespace" for BigQuery tables. This value should work fine.

0 comments on commit 7a88e4f

Please sign in to comment.