Migrate Upstream tests to community infrastructure

[nawazkh]

• CAPZ : Click me for the list of CAPZ tests to be migrated
• Other repos
  • image-builder : Keep mandatory presubmit ci working after 1st of august image-builder#1508
  • azuredisk-csi-driver: Migrate test-infra jobs to community infra azuredisk-csi-driver#2410
  • azurefile-csi-driver: Migrate test-infra jobs to community infrastructure azurefile-csi-driver#1988
  • cloud-provider-azure : Migrate test-infra jobs to community clusters cloud-provider-azure#6577
  • secrets-store-csi-driver: Migrate test-infra jobs to community infrastructure secrets-store-csi-driver#1572
  • windows-testing: Migrate test-infra jobs to community infrastructure windows-testing#453

---

CAPZ Test migration history

• cluster-api-provider-azure-presubmits-main.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
pull-cluster-api-provider-azure-e2e	PR: 32956	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-optional	PR: 32956	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-aks	PR: 32956	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-capi-e2e	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-with-ci-artifacts	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-ipv6-with-ci-artifacts	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-dual-stack-with-ci-artifacts	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-windows-with-ci-artifacts	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-windows-containerd-upstream-with-ci-artifacts-serial-slow	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-workload-upgrade	PR: 32956	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-apiversion-upgrade	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-ci-entrypoint	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-custom-builds	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-windows-custom-builds	PR: 32974	kubernetes/test-infra#33030 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-apidiff	WI creds not needed	running on k8s-infra-prow-build
pull-cluster-api-provider-azure-verify	WI creds not needed	running on eks-prow-build-cluster
pull-cluster-api-provider-azure-build	WI creds not needed	running on eks-prow-build-cluster
pull-cluster-api-provider-azure-test	WI creds not needed	running on eks-prow-build-cluster

• cluster-api-provider-azure-presubmits-release-v1beta1.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
pull-cluster-api-provider-azure-e2e-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-apiversion-upgrade-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-optional-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-aks-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-capi-e2e-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-ci-entrypoint-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-conformance-with-ci-artifacts-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-e2e-workload-upgrade-v1beta1	kubernetes/test-infra#32960	kubernetes/test-infra#32960 running on eks-prow-build-cluster
pull-cluster-api-provider-azure-test-v1beta1	Does not use WI creds	running on eks-prow-build-cluster
pull-cluster-api-provider-azure-build-v1beta1	Does not use WI creds	running on eks-prow-build-cluster
pull-cluster-api-provider-azure-verify-v1beta1	Does not use WI creds	running on eks-prow-build-cluster
pull-cluster-api-provider-azure-apidiff-v1beta1	Does not use WI creds	running on k8s-infra-prow-build

• cluster-api-provider-azure-periodics-main.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
periodic-cluster-api-provider-azure-conformance-main	PR: 32961	kubernetes/test-infra#33013 Running at k8s-infra-prow-build
periodic-cluster-api-provider-azure-conformance-with-ci-artifacts-main	PR: 32961	kubernetes/test-infra#33013 Running at k8s-infra-prow-build
periodic-cluster-api-provider-azure-capi-e2e-main	PR: 32961	PR: 33037 Running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-apiversion-upgrade-main	PR: 32961	PR: 33037 Running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-main	PR: 32961	PR: 33037 Running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-aks-main	PR: 32961	kubernetes/test-infra#33013 Running at k8s-infra-prow-build
periodic-cluster-api-provider-azure-coverage	Does not use WI creds	running on k8s-infra-prow-build

• cluster-api-provider-azure-periodics-main-upgrades.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
periodic-cluster-api-provider-azure-e2e-workload-upgrade-1-26-1-27-main	PR: 32963	kubernetes/test-infra#33027 working on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-workload-upgrade-1-27-1-28-main	PR: 32963	kubernetes/test-infra#33027 working on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-workload-upgrade-1-28-1-29-main	PR: 32963	PR: 33037 Running on eks-prow-build-cluster

• cluster-api-provider-azure-periodics-v1beta1-release-1.15.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
periodic-cluster-api-provider-azure-capi-e2e-v1beta1-release-1-15	kubernetes/test-infra#32964	kubernetes/test-infra#32964 working on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-v1beta1-release-1-15	kubernetes/test-infra#32964	kubernetes/test-infra#32964 working on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-aks-v1beta1-release-1-15	kubernetes/test-infra#32964	kubernetes/test-infra#32964 working on eks-prow-build-cluster

• cluster-api-provider-azure-periodics-v1beta1-release-1.16.yaml

Test Job Name	Migrate to use Workload Identity	Moved to community cluster
periodic-cluster-api-provider-azure-conformance-v1beta1-release-1-16	kubernetes/test-infra#32965	kubernetes/test-infra#32965 running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-conformance-v1beta1-with-ci-artifacts-release-1-16	kubernetes/test-infra#32965	kubernetes/test-infra#32965 running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-capi-e2e-v1beta1-release-1-16	kubernetes/test-infra#32965	kubernetes/test-infra#32965 running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-v1beta1-release-1-16	kubernetes/test-infra#32965	kubernetes/test-infra#32965 running on eks-prow-build-cluster
periodic-cluster-api-provider-azure-e2e-aks-v1beta1-release-1-16	kubernetes/test-infra#32965	kubernetes/test-infra#32965 running on eks-prow-build-cluster

Tasks

Beta Give feedback

1. Use the env AZURE_STORAGE_AUTH_MODE when using federated auth #4980
   approved cncf-cla: yes kind/bug lgtm release-note-none size/M +6
   
2. Use workload identity for azure cli when Federated token file is present #4939
   approved cncf-cla: yes kind/feature lgtm release-note size/M +6
   

   
3. migrate presubmit e2e test to use WI kubernetes/test-infra#32942
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/M +9
   
4. add missing azure storage account to the preset kubernetes/test-infra#32955
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/XS +9
   

   
5. migrate some of the CAPZ presubmit jobs to use wi kubernetes/test-infra#32956
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/L +9
   
6. Update presubmit v1beta1 release tests to use WI credentials kubernetes/test-infra#32960
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/M +9
   
7. Update periodic main test jobs to use WI credentials kubernetes/test-infra#32961
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/S +9
   
8. Update periodic main upgrades test jobs to use WI credentials kubernetes/test-infra#32963
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/S +9
   
9. Update periodics v1beta1 release 1.15 jobs to use community infra kubernetes/test-infra#32964
   approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/M +9
   
10. Create periodics v1beta1 release 1.16 using community infra for testing kubernetes/test-infra#32965
    approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/M +9
    
11. Place Holder PR for testing all the WI tests #4977
    cncf-cla: yes do-not-merge/hold kind/flake release-note-none size/XS +5
12. capz: use workload-identity for CAPZ CI presubmit jobs kubernetes/test-infra#32974
    approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/XL +9
    
13. drop Local only env var #4998
    approved cncf-cla: yes kind/cleanup lgtm release-note size/XS +6
    

    
14. Update CAPZ jobs to use community cluster. kubernetes/test-infra#33013
    approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/S +9
    
15. migrates some of the azure periodics main upgrades tests to eks infra kubernetes/test-infra#33027
    approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/S +9
    
16. Migrate Azure image-builder jobs to EKS infra kubernetes/test-infra#33029
    approved area/config area/jobs cncf-cla: yes lgtm sig/testing size/S +7
    
17. migrate capz presubmit main jobs to eks community infra kubernetes/test-infra#33030
    approved area/config area/jobs area/provider/azure cncf-cla: yes lgtm sig/cluster-lifecycle sig/testing size/L +9
    
18. image-builder: make pull-ova-all job optional kubernetes/test-infra#33052
    approved area/config area/jobs cncf-cla: yes lgtm sig/testing size/XS +7
    

[jsturtevant]

We will want to migrate all of the periodic as well, but this should be easier once pull requests are validated as they are similar code paths.

Once we've migrated to WI, we should be ready to transition to community cluster

[dtzar]

Closing this since all the CAPZ issues have been completed. If there issues or questions with others who depend on CAPZ, please feel free to file an issue, ping us on Slack, or come to the community call.