Decommission gke-project-pool

[spiffxp]

What should be cleaned up or changed:
We shouldn't be using gke-specific projects to run prowjobs for kubernetes. We have mostly stopped running jobs that require these, it's time to decommission the pool and identify whether jobs that still use these projects can use gce-project or should be running elsewhere.

Provide any links for context:
Related to:

• Migrate non-Kubernetes repos off of prow.k8s.io #12863
• Develop a prow migration plan k8s.io#752

/sig testing
/priority important-longterm
/area boskos
/area jobs
/milestone v1.23

[spiffxp]

Inspecting output of ripgrep -l gke config/jobs I believe the remaining offending jobs are:

• ci-kubernetes-e2e-gke-canary
• application-periodic-default-gke
• ci-kustomize-periodic-default-gke
• pull-sig-storage-local-static-provisioner-e2e-gke
• ci-sig-storage-local-static-provisioner-master-gke-default

Jobs I'm less certain about:

• pull-kubetest2-gke-up-down-singlecluster
• pull-kubetest2-gke-up-down-multicluster

[spiffxp]

Another way of surveying which jobs are actually using the projects

gcloud logging read \
  --project=k8s-prow-builds \
  --format=json \
  --limit=100 \
  --freshness=1d \
  '
  jsonPayload.component="boskos"
  jsonPayload.msg=~"Request for a free gke-project from"
  ' \
| jq -r 'map(.jsonPayload.msg)[]' \
| sort \
| uniq -c

  12 Request for a free gke-project from application-periodic-default-gke, dest busy
  48 Request for a free gke-project from ci-kubernetes-e2e-gke-canary, dest busy
  12 Request for a free gke-project from ci-kustomize-periodic-default-gke, dest busy
   6 Request for a free gke-project from ci-sig-storage-local-static-provisioner-master-gke-default-kubetest2, dest busy

[spiffxp]

Jobs to decomission or replace with alternatives:

• ci-kubernetes-e2e-gke-canary: PR to remove: config/jobs: rm ci-kubernetes-e2e-gke-canary #23819
• application-periodic-default-gke: Stop using application-periodic-default-gke job kubernetes-sigs/application#219, PR to remove: config/jobs: rm application-periodic-default-gke #23821
• ci-kustomize-periodic-default-gke: Stop using ci-kustomize-periodic-default-gke job kubernetes-sigs/kustomize#4214
• pull-sig-storage-local-static-provisioner-e2e-gke: PR to remove: config/jobs: remove *-sig-storage-local-static-provisioner-*-gke-* #23820
• ci-sig-storage-local-static-provisioner-master-gke-default: PR to remove: config/jobs: remove *-sig-storage-local-static-provisioner-*-gke-* #23820

[spiffxp]

Last 30d

All known jobs using this pool have been removed, going to open a final PR to remove the pool entirely

[spiffxp]

/close
Pool has been decommissioned

[k8s-ci-robot]

@spiffxp: Closing this issue.

In response to this:

/close
Pool has been decommissioned

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.