Use vSphere projects from Boskos

[sbueringer]

This is an umbrella issue for the migration to use vSphere projects only from Boskos.

For more context, see: kubernetes/k8s.io#6877

Prerequisites

• Setup Boskos in VMC
  • Done, configuration used can be seen here: vCenter and Boskos config for the vSphere environment sbueringer/k8s.io#1

Migration

• CAPV
  • PR to update test-infra to set BOSKOS_HOST: Add Boskos host to vSphere presets kubernetes/test-infra#32727
  • PR for main: ✨ test/e2e: use vSphere projects from Boskos #3034
  • cherry-pick to all branches with CI
    • [release-1.10] ✨ test/e2e: use vSphere projects from Boskos #3053
    • [release-1.9] ✨ test/e2e: use vSphere projects from Boskos #3054
    • [release-1.8] ✨ test/e2e: use vSphere projects from Boskos #3055
    • [release-1.7] ✨ test/e2e: use vSphere projects from Boskos #3056
• CPI
  • PR to update test-infra to set BOSKOS_HOST: Add Boskos host to vSphere presets kubernetes/test-infra#32727
  • PR for main: test/e2e: use vSphere projects from Boskos kubernetes/cloud-provider-vsphere#1067
  • cherry-pick to all branches with CI (delegated to CPI folks)
• image-builder
  • PR to update test-infra to set BOSKOS_HOST: Add Boskos host to vSphere presets kubernetes/test-infra#32727
  • PR for main: Use vSphere projects from Boskos image-builder#1487
  • no release branches => no cherry-picks necessary

Misc

• Increase # of CAPV projects to 40 (verify state "initializing" works)

Cleanup

• Cleanup janitor: 🌱 Cleanup janitor #3057
• Remove IPAM controller and corresponding objects from CAPV services cluster in VMC
• Remove old resource pools and folders in VMC (+ corresponding permissions) (also audit & cleanup the Google doc)
• Cleanup secrets:
  • Cleanup presets: Drop unused secrets from CAPV presets kubernetes/test-infra#32771
  • Clean up ExternalSecrets: config: remove unused secrets for capv and add janitor user kubernetes/test-infra#32688
    • capv-gcs-keyfile_json & vmc-capv-services_kubeconfig (TODO)
  • Cleanup the same in GCP secrets manager (check that they are unused)
    • Deleted vmc-capv-services_kubeconfig and capv-gcs-keyfile_json
• Rollout janitor user:
  • Secret PR for janitor creds: config: remove unused secrets for capv and add janitor user kubernetes/test-infra#32688
  • Update presets to point to janitor creds: capv: use janitor user and password in preset kubernetes/test-infra#32824
  • Remove CAPV user from janitor group

[sbueringer]

cc @chrischdi @fabriziopandini

[sbueringer]

Now moving on to the cleanup phase 🎉

[chrischdi]

Finished the cleanup 🎉

/close

[k8s-ci-robot]

@chrischdi: Closing this issue.

In response to this:

Finished the cleanup 🎉

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.