Reduce time it takes to build all images

[jose5918]

Takes a long time to build all images. There are several ways to speed up the e2e tests.

The easiest way, with the least benefit, would be to add a .glcoudignore file like in the other repos. This will prevent uploading the entire vendor directory every time you submit a docker build to gcloud.

The second would be to run container builds in parallel using argo rather than sequentially.

Any other ideas?

[gaocegege]

I think we could remove go build statements since we will build them again when building the images.

[gaocegege]

@gaocegege a few of things that can be done here. Pull the image golang:alpine and push it to gcr.io to reduce number of pull failures. Retry on build failures, and add a .gcloudignore to your repository. Even better would be to add a retry and run your container builds in parallel to reduce the points of failure.

[gaocegege]

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/kubeflow_katib/83/kubeflow-katib-presubmit/39/
http://testing-argo.kubeflow.org/workflows/kubeflow-test-infra/kubeflow-katib-presubmit-e2e-83-84b74b0-39-869b?tab=workflow

We spend 40 mins in building and it causes time out in Prow. We need to fix it ASAP.

[YujiOshima]

I will address this right now.

[gaocegege]

Thanks 👍

😄