Developer Experience Improvements

[ConnorJC3]

Is this a bug fix or adding new feature?

Neither - it focuses on improvements to the developer experience.

What is this PR about? / Why do we need it?

This PR contains several improvements split up by commit:

Only collect metrics in Prow

Metrics collection runs locally by default, but this makes no sense because the metrics will fail to publish anyways. Check for the presence of PROW_JOB_ID and only run metrics in Prow jobs.

Simplify image building

Simplifies handling of image building in the Makefile. Removes some CI-only defaults from the Makefile that are confusing and difficult to use. Renames hack/prow.sh to hack/cloudbuild.sh to clearly indicate what it is used for.

Split driver install/uninstall out to functions; Introduce make cluster/(un)install

Introduces make cluster/install and make cluster/uninstall which can be used to (un)install the driver for local testing. In order to accomplish this, driver installation and uninstallation are split out into a separate function in utils.sh

Cache GOCACHE and GOMODCACHE in Dockerfile

Configures the Dockerfile to cache go modules and build output on supported platforms. In my local testing, this introduced an approximate 30x speedup (from 600 seconds to 20 seconds) when rebuilding the driver image with a small change (such as a dependency upgrade) to go.mod.

Update Makefile documentation and CONTRIBUTING.md

Makefile documentation was somewhat out of date, cleans it up. Also moves the quickstart guide to CONTRIBUTING.md and cleans up outdated information in CONTRIBUTING.md.

Cleanup non-external e2e test handling

Cleans up the logic of non-external tests, fixing a bug that causes the tests to fail to run when run from inside a home directory that is a symlink.

What testing is done?

CI/Manual

[github-actions]

Code Coverage Diff

This PR does not change the code coverage

[AndrewSirenko]

Thanks for these amazing devloop + new contributor improvements.

TIL: cache mounts... (Thank you for this...)

xref: #1929 (Because this PR resolves checklist items 1,2, and 3)

Working my way through testing the PR, eta end of week.

[AndrewSirenko]

Thank you for this. It erases so many minutes from creating/reviewing PRs.

Left mostly non-blocking comments except for adding a pre-requisite for having a private ECR repository named aws-ebs-csi-driver (or overriding that default)

Besides ^^, I went through the new contributing guide steps and it all worked for me :)

[AndrewSirenko]

Can we directly reference these same steps in contributing-guide instead of having the same information in two places?

Would also shorten this document.

[ConnorJC3]

Ah, yes, I swear I did that but I think I reverted this file on accident when messing with git rebasing - will fix in next rev

[torredil]

/lgtm

[AndrewSirenko]

/lgtm

Will approve once devloop with EKS confirmed works.

[AndrewSirenko]

/lgtm
/approve

[ConnorJC3]

/retest

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: AndrewSirenko

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [AndrewSirenko]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[AndrewSirenko]

/lgtm