Add template compilation

GoogleCloudPlatform · Aug 20, 2020 · d268bba · d268bba
1 parent 5136fd2
commit d268bba
Show file tree

Hide file tree

Showing 2 changed files with 21 additions and 3 deletions.
diff --git a/tutorials/schedule-dataflow-jobs-with-cloud-scheduler/index.md b/tutorials/schedule-dataflow-jobs-with-cloud-scheduler/index.md
@@ -107,11 +107,10 @@ gcloud projects add-iam-policy-binding ${GOOGLE_CLOUD_PROJECT} --member serviceA
   --role roles/storage.admin
 ```
 
-Create a bucket on Google Cloud Stoeage, copy the Dataflow templates there and set up the Terraform backend.
+Create a bucket on Google Cloud Stoeage and set up the Terraform backend.
 
 ```
 gsutil mb -p ${GOOGLE_CLOUD_PROJECT} gs://${TF_ADMIN}
-gsutil cp -R scheduler-dataflow-demo/dataflow gs://${TF_ADMIN}/templates/dataflow-demo-template
 cat > backend.tf << EOF
 terraform {
  backend "gcs" {
@@ -122,7 +121,14 @@ terraform {
 EOF
 ```
 
-You are now ready to initialize and run Terraform.
+Compile and upload the Dataflow template.
+
+```
+cd ../dataflow
+. maven.sh
+```
+
+You are now ready to initialize and apply Terraform.
 
 ```
 cd scheduler-dataflow-demo/terraform

diff --git a/...als/schedule-dataflow-jobs-with-cloud-scheduler/scheduler-dataflow-demo/dataflow/maven.sh b/...als/schedule-dataflow-jobs-with-cloud-scheduler/scheduler-dataflow-demo/dataflow/maven.sh
@@ -0,0 +1,12 @@
+#!/bin/bash
+PROJECT=${GOOGLE_CLOUD_PROJECT}
+BUCKET=${TF_ADMIN}
+mvn compile exec:java \
+           -Dexec.mainClass=DataflowDemoPipeline \
+           -Dexec.args="--runner=DataflowRunner \
+                        --project=${PROJECT} \
+                        --stagingLocation=gs://${BUCKET}/staging \
+                        --gcpTempLocation=gs://${BUCKET}/temp \
+                        --region=us-central1 \
+                        --templateLocation=gs://${BUCKET}/templates/dataflow-demo-template"
+