Add check/wait for PVC deletion after pod deletion in ephemeral volume support e2e case

[Rakshith-R]

Describe the bug

ephemeral volume support e2e fails rarely when pvc isn't immediately deleted by kublet after pod deletion.

A step needs to be added at line 811 below to wait for pvc deletion with timeout.

ceph-csi/e2e/rbd.go

Lines 793 to 819 in 37f1d72

	By("verify generic ephemeral volume support", func() {
	// create application
	app, err := loadApp(appEphemeralPath)
	if err != nil {
	framework.Failf("failed to load application: %v", err)
	}
	app.Namespace = f.UniqueName
	err = createApp(f.ClientSet, app, deployTimeout)
	if err != nil {
	framework.Failf("failed to create application: %v", err)
	}
	// validate created backend rbd images
	validateRBDImageCount(f, 1, defaultRBDPool)
	validateOmapCount(f, 1, rbdType, defaultRBDPool, volumesType)
	err = deletePod(app.Name, app.Namespace, f.ClientSet, deployTimeout)
	if err != nil {
	framework.Failf("failed to delete application: %v", err)
	}
	// validate created backend rbd images
	validateRBDImageCount(f, 0, defaultRBDPool)
	validateOmapCount(f, 0, rbdType, defaultRBDPool, volumesType)
	// validate images in trash
	err = waitToRemoveImagesFromTrash(f, defaultRBDPool, deployTimeout)
	if err != nil {
	framework.Failf("failed to validate rbd images in pool %s trash: %v", defaultRBDPool, err)
	}
	})

similar step needs to be added to cephfs e2e too.

Failed ci:

• https://jenkins-ceph-csi.apps.ocp.cloud.ci.centos.org/blue/organizations/jenkins/mini-e2e-helm_k8s-1.25/detail/mini-e2e-helm_k8s-1.25/522/pipeline/109/
• logs: https://jenkins-ceph-csi.apps.ocp.cloud.ci.centos.org/blue/rest/organizations/jenkins/pipelines/mini-e2e-helm_k8s-1.25/runs/522/nodes/109/log/?start=0
• https://jenkins-ceph-csi.apps.ocp.cloud.ci.centos.org/blue/rest/organizations/jenkins/pipelines/mini-e2e-helm_k8s-1.25/runs/522/nodes/100/steps/103/log/?start=0

ctrl+f pvc-3bff7e9f-5dea-48f8-8c97-92d8b0b942f5

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.