Auth v1:

[root@master-1-eS6qj1hngsjdO e2e]# ./run-e2e-test.sh --minimal --pscale
/root/csm-operator/tests/e2e
  W1011 07:12:51.744850 1904216 test_context.go:538] Unable to find in-cluster config, using default host : https://127.0.0.1:6443
  I1011 07:12:51.744972 1904216 test_context.go:561] The --provider flag is not set. Continuing as if --provider=skeleton had been used.
Running Suite: CSM Operator End-to-End Tests - /root/csm-operator/tests/e2e
===========================================================================
Random Seed: 1728645156Will run 1 of 1 specs
------------------------------
[BeforeSuite] 
/root/csm-operator/tests/e2e/e2e_test.go:99
  STEP: Getting test environment variables @ 10/11/24 07:12:51.745
  STEP: [powerscale] @ 10/11/24 07:12:51.745
  STEP: Reading values file @ 10/11/24 07:12:51.745
  STEP: Getting a k8s client @ 10/11/24 07:12:51.746
[BeforeSuite] PASSED [0.004 seconds]
------------------------------
[run-e2e-test] E2E Testing Running all test Given Test Scenarios
/root/csm-operator/tests/e2e/e2e_test.go:140
  STEP: Starting: Install PowerScale Driver(With Authorization V1)  @ 10/11/24 07:12:51.749
  STEP: Returning false here @ 10/11/24 07:12:51.749
  STEP:      Executing  Given an environment with k8s or openshift, and CSM operator installed @ 10/11/24 07:12:51.749
  STEP:      Executing  Create [authorization-proxy-server] prerequisites from CR [1] @ 10/11/24 07:12:51.913
=== Creating Authorization Proxy Server Prerequisites ===
  STEP:      Executing  Apply custom resource [1] @ 10/11/24 07:12:54.061
  I1011 07:12:54.062095 1904216 builder.go:121] Running '/usr/bin/kubectl --namespace=authorization apply --validate=true -f -'
  I1011 07:12:54.238521 1904216 builder.go:146] stderr: ""
  I1011 07:12:54.238572 1904216 builder.go:147] stdout: "containerstoragemodule.storage.dell.com/authorization created\nconfigmap/csm-config-params created\n"
  STEP:      Executing  Validate [authorization-proxy-server] module from CR [1] is installed @ 10/11/24 07:12:54.238
  STEP:      Executing  Configure authorization-proxy-server for [powerscale] for CR [1] @ 10/11/24 07:13:24.265
=== Configuring Authorization Proxy Server ===
Address: csm-authorization.com
=====Waiting for everything to be up and running, adding a sleep time of 60 seconds before creating the role, tenant and role binding===
=== Generating Admin Token ===
=== Writing Admin Token to Tmp File ===
 === Creating Storage ===
 
=== Storage === 
 /usr/local/bin/karavictl --admin-token /tmp/adminToken.yaml storage create --type powerscale --endpoint https://x.x.x.x:8080 --system-id PIE-IsilonS-24241-Cluster --user root --password pancake --array-insecure --insecure --addr csm-authorization.com:31272
=== Creating Tenant ===
 
=== Tenant === 
 /usr/local/bin/karavictl --admin-token /tmp/adminToken.yaml tenant create -n PancakeGroup --insecure --addr csm-authorization.com:31272
=== Creating Role ===
 
=== Role === 
 /usr/local/bin/karavictl --admin-token /tmp/adminToken.yaml role create --role=CSIGold=powerscale=PIE-IsilonS-24241-Cluster=ifs/data/csi=0 --insecure --addr csm-authorization.com:31272
=== Creating RoleBinding ===
 
=== Binding Role ===
 /usr/local/bin/karavictl --admin-token /tmp/adminToken.yaml rolebinding create --tenant PancakeGroup --role CSIGold --insecure --addr csm-authorization.com:31272
=== Generating token ===
 
=== Token ===
 /usr/local/bin/karavictl --admin-token /tmp/adminToken.yaml generate token --tenant PancakeGroup --insecure --addr csm-authorization.com:31272 --access-token-expiration 2h0m0s
=== Applying token ===
 
=== Token Applied ===
 
  STEP:      Executing  Set up secret with template [testfiles/powerscale-templates/powerscale-secret-template.yaml] name [isilon-creds] in namespace [isilon] for [pscale] @ 10/11/24 07:14:30.489
  STEP:      Executing  Create storageclass with name [op-e2e-isilon] and template [testfiles/powerscale-templates/powerscale-storageclass-template.yaml] for [pscale] @ 10/11/24 07:14:30.826
  STEP:      Executing  Set up secret with template [testfiles/powerscale-templates/powerscale-auth-secret-template.yaml] name [isilon-creds-auth] in namespace [isilon] for [pscaleAuth] @ 10/11/24 07:14:31.155
  STEP:      Executing  Set up secret with template [testfiles/powerscale-templates/karavi-authorization-config.json] name [karavi-authorization-config] in namespace [isilon] for [pscaleAuthSidecar] @ 10/11/24 07:14:31.493
  STEP:      Executing  Set up secret with template [testfiles/authorization-templates/rootCertificate.pem] name [proxy-server-root-certificate] in namespace [isilon] for [authSidecarCert] @ 10/11/24 07:14:31.778
  STEP:      Executing  Apply custom resource [2] @ 10/11/24 07:14:32.031
  I1011 07:14:32.031554 1904216 builder.go:121] Running '/usr/bin/kubectl --namespace=isilon apply --validate=true -f -'
  I1011 07:14:32.152228 1904216 builder.go:146] stderr: ""
  I1011 07:14:32.152284 1904216 builder.go:147] stdout: "containerstoragemodule.storage.dell.com/isilon created\n"
  STEP:      Executing  Validate custom resource [2] @ 10/11/24 07:14:32.152
  STEP:      Executing  Validate [powerscale] driver from CR [2] is installed @ 10/11/24 07:14:52.187
  STEP:      Executing  Validate [authorization] module from CR [2] is installed @ 10/11/24 07:15:12.201
map[com.dell.karavi-authorization-proxy:true deployment.kubernetes.io/revision:1]
map[com.dell.karavi-authorization-proxy:true deprecated.daemonset.template.generation:1]
  STEP:      Executing  Run custom test @ 10/11/24 07:15:22.243
  I1011 07:15:22.243332 1904216 util.go:650] Running cert-csi [test vio --sc op-e2e-isilon --chainNumber 2 --chainLength 2]
[2024-10-11 07:15:22]  INFO Starting cert-csi; ver. 1.4.1
[2024-10-11 07:15:22]  INFO Using EVENT observer type
[2024-10-11 07:15:22]  INFO Using config from /etc/kubernetes/admin.conf
[2024-10-11 07:15:22]  INFO Successfully loaded config. Host: https://x.x.x.x:6443
[2024-10-11 07:15:22]  INFO Created new KubeClient
[2024-10-11 07:15:22]  INFO Running 1 iteration(s)
[2024-10-11 07:15:22]  INFO     *** ITERATION NUMBER 1 ***
[2024-10-11 07:15:22]  INFO Starting VolumeIoSuite with op-e2e-isilon storage class
[2024-10-11 07:15:22]  INFO Successfully created namespace volumeio-test-8e236395
[2024-10-11 07:15:22]  INFO Using default number of volumes
[2024-10-11 07:15:22]  INFO Using default image: docker.io/centos:latest
[2024-10-11 07:15:22]  INFO Creating IO pod
[2024-10-11 07:15:24]  INFO Waiting for pod iowriter-test-ckxqg to be READY
[2024-10-11 07:15:28]  INFO Waiting for pod iowriter-test-5t44n to be READY
[2024-10-11 07:15:34]  INFO Executing command: [/bin/bash -c dd if=/dev/urandom bs=1M count=128 oflag=sync > /data0/writer-0.data]
[2024-10-11 07:15:34]  INFO Executing command: [/bin/bash -c dd if=/dev/urandom bs=1M count=128 oflag=sync > /data0/writer-1.data]
[2024-10-11 07:15:37]  INFO Executing command: [/bin/bash -c sha512sum /data0/writer-0.data > /data0/writer-0.sha512]
[2024-10-11 07:15:37]  INFO Executing command: [/bin/bash -c sha512sum /data0/writer-1.data > /data0/writer-1.sha512]
[2024-10-11 07:15:43]  INFO Waiting until no Volume Attachments with PV k8s-832b4b59e4 left
[2024-10-11 07:15:43]  INFO Waiting until no Volume Attachments with PV k8s-9512385abc left
[2024-10-11 07:15:43]  INFO VolumeAttachment deleted
[2024-10-11 07:15:43]  INFO Waiting for pod iowriter-test-gp2t9 to be READY
[2024-10-11 07:15:53]  INFO VolumeAttachment deleted
[2024-10-11 07:15:53]  INFO Waiting for pod iowriter-test-z9c7q to be READY
[2024-10-11 07:15:55]  INFO Executing command: [/bin/bash -c sha512sum -c /data0/writer-0.sha512]
[2024-10-11 07:15:58]  INFO Hashes match
[2024-10-11 07:15:58]  INFO Executing command: [/bin/bash -c dd if=/dev/urandom bs=1M count=128 oflag=sync > /data0/writer-0.data]
[2024-10-11 07:16:00]  INFO Executing command: [/bin/bash -c sha512sum /data0/writer-0.data > /data0/writer-0.sha512]
[2024-10-11 07:16:04]  INFO Waiting until no Volume Attachments with PV k8s-832b4b59e4 left
[2024-10-11 07:16:06]  INFO Executing command: [/bin/bash -c sha512sum -c /data0/writer-1.sha512]
[2024-10-11 07:16:08]  INFO Hashes match
[2024-10-11 07:16:08]  INFO Executing command: [/bin/bash -c dd if=/dev/urandom bs=1M count=128 oflag=sync > /data0/writer-1.data]
[2024-10-11 07:16:10]  INFO Executing command: [/bin/bash -c sha512sum /data0/writer-1.data > /data0/writer-1.sha512]
[2024-10-11 07:16:14]  INFO Waiting until no Volume Attachments with PV k8s-9512385abc left
[2024-10-11 07:16:16]  INFO VolumeAttachment deleted
[2024-10-11 07:16:26]  INFO VolumeAttachment deleted
[2024-10-11 07:16:26]  INFO Deleting all resources in namespace volumeio-test-8e236395
[2024-10-11 07:16:38]  INFO Namespace volumeio-test-8e236395 was deleted in 12.014666043s
[2024-10-11 07:16:42]  INFO SUCCESS: VolumeIoSuite in 1m20.3466189s
[2024-10-11 07:16:42]  INFO Started generating reports...
Collecting metrics
1 / 1 [---------------------------------------------------------------------------------------------------------------------------------------] 100.00% ? p/sCollecting metrics
[2024-10-11 07:16:42]  INFO Started generating reports...
Generating plots
1 / 1 [---------------------------------------------------------------------------------------------------------------------------------------] 100.00% ? p/s1 / 1 [-------------------------------------------------------------------------------------------------------------------------------------->] 100.00% ? p/s1 / 1 [--------------------------------------------------------------------------------------------------------------------------------------] 100.00% 37 p/s[2024-10-11 07:16:43]  WARN No ResourceUsageMetrics provided
[2024-10-11 07:16:43] ERROR no ResourceUsageMetrics provided
report-test-run-3e660e26:
Name: test-run-3e660e26
Host: https://x.x.x.x:6443
StorageClass: op-e2e-isilon
Minimum and Maximum EntityOverTime charts:/root/.cert-csi/reports/test-run-3e660e26/PodsCreatingOverTime.png/root/.cert-csi/reports/test-run-3e660e26/PodsReadyOverTime.png/root/.cert-csi/reports/test-run-3e660e26/PodsTerminatingOverTime.png/root/.cert-csi/reports/test-run-3e660e26/PvcsCreatingOverTime.png/root/.cert-csi/reports/test-run-3e660e26/PvcsBoundOverTime.pngTests:
--------------------------------------------------------------
1. TestCase: VolumeIoSuite
            Started:   2024-10-11 07:15:22.411461328 -0400 -0400
            Ended:     2024-10-11 07:16:42.782836052 -0400 -0400
            Result:    SUCCESS            Stage metrics:
                    PVCBind:
                        Avg: 2.350609252s
                        Min: 1.849242683s
                        Max: 2.851975822s
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCBind.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCBind_boxplot.png
                    PVCCreation:
                        Avg: 4.832132454s
                        Min: 4.31806021s
                        Max: 5.346204698s
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCCreation.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCCreation_boxplot.png
                    PVCDeletion:
                        Avg: 14.928029ms
                        Min: 14.691474ms
                        Max: 15.164584ms
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCDeletion.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCDeletion_boxplot.png
                    PVCUnattachment:
                        Avg: 31.718134649s
                        Min: 31.573933122s
                        Max: 31.862336176s
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCUnattachment.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PVCUnattachment_boxplot.png
                    PodCreation:
                        Avg: 8.610835441s
                        Min: 4.755422008s
                        Max: 10.58146935s
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PodCreation.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PodCreation_boxplot.png
                    PodDeletion:
                        Avg: 995.47386ms
                        Min: 876.570734ms
                        Max: 1.226872513s
                        Histogram:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PodDeletion.png
                        BoxPlot:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/PodDeletion_boxplot.png
                        EntityNumberOverTime:
        /root/.cert-csi/reports/test-run-3e660e26/VolumeIoSuite10/EntityNumberOverTime.png[2024-10-11 07:16:43]  INFO Avg time of a run:   64.26s
[2024-10-11 07:16:43]  INFO Avg time of a del:   12.02s
[2024-10-11 07:16:43]  INFO Avg time of all:     80.33s
[2024-10-11 07:16:43]  INFO During this run 100.0% of suites succeeded
  STEP:      Executing  Enable forceRemoveDriver on CR [2] @ 10/11/24 07:16:43.306err: Operation cannot be fulfilled on containerstoragemodules.storage.dell.com "isilon": the object has been modified; please apply your changes to the latest version and try again
  STEP:      Executing  Delete custom resource [2] @ 10/11/24 07:16:53.602
  STEP:      Executing  Delete custom resource [1] @ 10/11/24 07:16:53.709
  STEP:      Executing  Restore template [testfiles/powerscale-templates/powerscale-auth-secret-template.yaml] for [pscaleAuth] @ 10/11/24 07:16:53.736
  STEP:      Executing  Restore template [testfiles/powerscale-templates/karavi-authorization-config.json] for [pscaleAuthSidecar] @ 10/11/24 07:16:53.85
  STEP: Ending: Install PowerScale Driver(With Authorization V1)
   @ 10/11/24 07:16:53.928
• [247.183 seconds]
------------------------------Ran 1 of 1 Specs in 247.188 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
PASSGinkgo ran 1 suite in 4m22.671761855s
Test Suite Passed