Endpoint /var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock
Removed endpoint /var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock
ls: cannot access '/var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock': No such file or directory
time="2022-01-11T20:31:13Z" level=info  runid=start msg="Driver Mode:node" func="github.com/dell/csi-unity/service.(*service).BeforeServe()" file="/go/src/csi-unity/service/service.go:174"
time="2022-01-11T20:31:13Z" level=info  runid=start msg="X_CSI_UNITY_NODENAME: k8s-single" func="github.com/dell/csi-unity/service.(*service).BeforeServe()" file="/go/src/csi-unity/service/service.go:182"
time="2022-01-11T20:31:13Z" level=info  runid=config-0 msg="*************Synchronizing driver secret**************" func="github.com/dell/csi-unity/service.(*service).syncDriverSecret()" file="/go/src/csi-unity/service/service.go:459"
time="2022-01-11T20:31:13Z" level=info msg="configured csi-unity.dellemc.com" ArrayId=virt21512v5f91 Endpoint="https://192.168.192.202/" IsDefault=true SkipCertificateValidation=true password="*******" username=admin
time="2022-01-11T20:31:13Z" level=info  runid=node-0 msg="Starting goroutine to add Node information to storage array" func="github.com/dell/csi-unity/service.(*service).syncNodeInfoRoutine()" file="/go/src/csi-unity/service/node.go:1829"
time="2022-01-11T20:31:13Z" level=info arrayid=virt21512v5f91 runid=config-1 msg="Dynamic config load goroutine invoked" func="github.com/dell/csi-unity/service.(*service).loadDynamicConfig()" file="/go/src/csi-unity/service/service.go:374"
csi-unity logger initiated. This should be called only once.
gounity logger initiated. This should be called only once.
time="2022-01-11T20:31:13Z" level=info  runid=config-0 msg="configured csi-unity.dellemc.com" func="github.com/dell/csi-unity/service.(*service).BeforeServe.func1()" file="/go/src/csi-unity/service/service.go:169"
time="2022-01-11T20:31:13Z" level=info msg="identity service registered"
time="2022-01-11T20:31:13Z" level=info msg="node service registered"
time="2022-01-11T20:31:13Z" level=info  runid=RegisterAdditionalServers msg="Registering additional GRPC servers" func="github.com/dell/csi-unity/service.(*service).RegisterAdditionalServers()" file="/go/src/csi-unity/service/service.go:286"
time="2022-01-11T20:31:13Z" level=info msg=serving endpoint="unix:///var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock"
time="2022-01-11T20:31:13Z" level=info arrayid=virt21512v5f91 runid=config-1 msg="*************Synchronizing driver config**************" func="github.com/dell/csi-unity/service.(*service).syncDriverConfig()" file="/go/src/csi-unity/service/service.go:560"
time="2022-01-11T20:31:13Z" level=warning arrayid=virt21512v5f91 runid=config-1 msg="Log level changed to: info" func="github.com/dell/csi-unity/service.(*service).syncDriverConfig()" file="/go/src/csi-unity/service/service.go:578"
time="2022-01-11T20:31:13Z" level=info msg="/csi.v1.Identity/GetPluginInfo: REQ 0001: XXX_NoUnkeyedLiteral={}, XXX_sizecache=0"
time="2022-01-11T20:31:13Z" level=info msg="/csi.v1.Identity/GetPluginInfo: REP 0001: Name=csi-unity.dellemc.com, VendorVersion=2.1.0, Manifest=map[commit:79d94eb4d3eb0521fcf489053c544b290d0595db formed:Fri, 03 Dec 2021 09:51:20 UTC semver:2.1.0 url:http://github.com/dell/csi-unity], XXX_NoUnkeyedLiteral={}, XXX_sizecache=0"
time="2022-01-11T20:31:14Z" level=warning arrayid=virt21512v5f91 runid=node-2 msg="Cannot read directory: /sys/class/fc_host : open /sys/class/fc_host: no such file or directory" func="github.com/dell/csi-unity/service/utils.GetFCInitiators()" file="/go/src/csi-unity/service/utils/emcutils.go:95"
time="2022-01-11T20:31:14Z" level=warning arrayid=virt21512v5f91 runid=node-2 msg="'FC Initiators' cannot be retrieved." func="github.com/dell/csi-unity/service.(*service).addNodeInformationIntoArray()" file="/go/src/csi-unity/service/node.go:1591"
time="2022-01-11T20:31:14Z" level=info msg="URI/api/instances/host/name:k8s-single?fields=id,name,description,fcHostInitiators,iscsiHostInitiators,hostIPPorts?fields" func="github.com/dell/gounity.(*host).FindHostByName()" file="dell/gounity@v1.8.0/host.go:42"
time="2022-01-11T20:31:14Z" level=error msg="failed to invoke Unity REST API server" func="github.com/dell/gounity.(*Client).executeWithRetryAuthenticate()" file="dell/gounity@v1.8.0/unityclient.go:127" error="[{The requested resource does not exist. (Error Code:0x7d13005)}]"
time="2022-01-11T20:31:14Z" level=info msg="URI/api/instances/host/name:k8s-single?fields=id,name,description,fcHostInitiators,iscsiHostInitiators,hostIPPorts?fields" func="github.com/dell/gounity.(*host).FindHostByName()" file="dell/gounity@v1.8.0/host.go:42"
time="2022-01-11T20:31:14Z" level=error msg="failed to invoke Unity REST API server" func="github.com/dell/gounity.(*Client).executeWithRetryAuthenticate()" file="dell/gounity@v1.8.0/unityclient.go:127" error="[{The requested resource does not exist. (Error Code:0x7d13005)}]"
time="2022-01-11T20:31:14Z" level=error msg="failed to invoke Unity REST API server" func="github.com/dell/gounity.(*Client).executeWithRetryAuthenticate()" file="dell/gounity@v1.8.0/unityclient.go:127" error="[{Requested element, property or action does not exist:[tenant]. (Error Code:0x7d13137)}]"
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x166a366]
goroutine 13 [running]:
github.com/dell/csi-unity/service.(*service).addNewNodeToArray(0xc000548000, 0x1bebae0, 0xc0004d4ba0, 0xc00007a960, 0xc0001f84b0, 0x1, 0x1, 0xc0001f8370, 0x1, 0x1, ...)
	/go/src/csi-unity/service/node.go:1771 +0x146
github.com/dell/csi-unity/service.(*service).addNodeInformationIntoArray(0xc000548000, 0x1bebae0, 0xc0004d49f0, 0xc00007a960, 0x1bebae0, 0xc0004d49f0)
	/go/src/csi-unity/service/node.go:1620 +0x819
github.com/dell/csi-unity/service.(*service).syncNodeInfo.func2.1(0x1bebae0, 0xc0004d4870, 0xc000548000, 0xc00007a960)
	/go/src/csi-unity/service/node.go:1875 +0xa5
created by github.com/dell/csi-unity/service.(*service).syncNodeInfo.func2
	/go/src/csi-unity/service/node.go:1873 +0x85
I0111 20:31:13.893812       1 main.go:164] Version: v2.3.0
I0111 20:31:13.901556       1 main.go:165] Running node-driver-registrar in mode=registration
I0111 20:31:13.902232       1 main.go:189] Attempting to open a gRPC connection with: "/csi/csi_sock"
I0111 20:31:13.902250       1 connection.go:154] Connecting to unix:///csi/csi_sock
I0111 20:31:13.904502       1 main.go:196] Calling CSI driver to discover driver name
I0111 20:31:13.904511       1 connection.go:183] GRPC call: /csi.v1.Identity/GetPluginInfo
I0111 20:31:13.904518       1 connection.go:184] GRPC request: {}
I0111 20:31:13.907170       1 connection.go:186] GRPC response: {"manifest":{"commit":"79d94eb4d3eb0521fcf489053c544b290d0595db","formed":"Fri, 03 Dec 2021 09:51:20 UTC","semver":"2.1.0","url":"http://github.com/dell/csi-unity"},"name":"csi-unity.dellemc.com","vendor_version":"2.1.0"}
I0111 20:31:13.907210       1 connection.go:187] GRPC error: <nil>
I0111 20:31:13.907214       1 main.go:206] CSI driver name: "csi-unity.dellemc.com"
I0111 20:31:13.907246       1 node_register.go:52] Starting Registration Server at: /registration/csi-unity.dellemc.com-reg.sock
I0111 20:31:13.908423       1 node_register.go:61] Registration Server started at: /registration/csi-unity.dellemc.com-reg.sock
I0111 20:31:13.908466       1 node_register.go:91] Skipping healthz server because HTTP endpoint is set to: ""
E0111 20:31:14.683304       1 connection.go:132] Lost connection to unix:///csi/csi_sock.
I0111 20:31:15.661914       1 main.go:100] Received GetInfo call: &InfoRequest{}
I0111 20:31:15.662451       1 main.go:107] "Kubelet registration probe created" path="/var/lib/kubelet/plugins/unity.emc.dell.com/registration"
I0111 20:31:15.667255       1 main.go:118] Received NotifyRegistrationStatus call: &RegistrationStatus{PluginRegistered:false,Error:RegisterPlugin error -- plugin registration failed with err: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock: connect: connection refused",}
E0111 20:31:15.667278       1 main.go:120] Registration process failed with error: RegisterPlugin error -- plugin registration failed with err: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /var/lib/kubelet/plugins/unity.emc.dell.com/csi_sock: connect: connection refused", restarting registration container.