I1111 20:12:46.540225 1 csi-provisioner.go:65] Version: v0.3.0-0-g9c96b1f2 I1111 20:12:46.540294 1 csi-provisioner.go:79] Building kube configs for running in cluster... I1111 20:12:49.588610 1 controller.go:112] Connecting to /var/lib/kubelet/plugins/csi-cephfsplugin/csi.sock I1111 20:12:49.589007 1 controller.go:139] Still trying, connection is CONNECTING I1111 20:12:49.589254 1 controller.go:136] Connected I1111 20:12:49.590641 1 controller.go:492] Starting provisioner controller 297de6f7-e5ee-11e8-aa64-5a04f12c068e! I1111 20:12:49.590917 1 reflector.go:202] Starting reflector *v1.StorageClass (15s) from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498 I1111 20:12:49.590947 1 reflector.go:240] Listing and watching *v1.StorageClass from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498 I1111 20:12:49.591201 1 reflector.go:202] Starting reflector *v1.PersistentVolume (15s) from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497 I1111 20:12:49.591222 1 reflector.go:240] Listing and watching *v1.PersistentVolume from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497 I1111 20:12:49.591919 1 reflector.go:202] Starting reflector *v1.PersistentVolumeClaim (15s) from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496 I1111 20:12:49.591946 1 reflector.go:240] Listing and watching *v1.PersistentVolumeClaim from github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496 I1111 20:13:04.594219 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:13:04.595015 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:13:04.596360 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:13:19.594566 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:13:19.595367 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:13:19.596605 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:13:34.594794 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:13:34.595584 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:13:34.596819 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:13:49.595218 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:13:49.595882 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:13:49.597071 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:14:01.894724 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:01.925969 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:14:01.933321 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:14:01.933388 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:01.933407 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:14:01.933414 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:14:01.939092 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:14:01.939110 1 controller.go:104] GRPC request: I1111 20:14:01.939953 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:01.940035 1 controller.go:107] GRPC error: I1111 20:14:01.940058 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:14:01.940066 1 controller.go:104] GRPC request: I1111 20:14:01.940688 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:01.940746 1 controller.go:107] GRPC error: I1111 20:14:01.940765 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:14:01.940772 1 controller.go:104] GRPC request: I1111 20:14:01.941213 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:14:01.941267 1 controller.go:107] GRPC error: I1111 20:14:01.971886 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:14:01.971938 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:14:02.125615 1 controller.go:106] GRPC response: I1111 20:14:02.125801 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:02.125899 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:02.126089 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:14:02.626020313 +0000 UTC m=+76.096036687 (durationBeforeRetry 500ms). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-54a2ccde-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:14:02.129924 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b097a352091 default/csi-cephfs-pvc ProvisioningFailed I1111 20:14:03.937935 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:14:03.938004 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:14:04.595471 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:14:04.596049 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:14:04.596135 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:04.596185 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:14:04.597230 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:14:04.604563 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:14:04.604584 1 controller.go:104] GRPC request: I1111 20:14:04.605153 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:04.605250 1 controller.go:107] GRPC error: I1111 20:14:04.605278 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:14:04.605286 1 controller.go:104] GRPC request: I1111 20:14:04.605678 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:04.605717 1 controller.go:107] GRPC error: I1111 20:14:04.605749 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:14:04.605757 1 controller.go:104] GRPC request: I1111 20:14:04.606176 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:14:04.606209 1 controller.go:107] GRPC error: I1111 20:14:04.614039 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:14:04.614055 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:14:04.736863 1 controller.go:106] GRPC response: I1111 20:14:04.736911 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:04.737084 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:04.737190 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:14:05.737160416 +0000 UTC m=+79.207176740 (durationBeforeRetry 1s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5635d43e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:14:19.595682 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:14:19.596242 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:14:19.596317 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:19.596356 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:14:19.597382 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:14:19.600408 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:14:19.600426 1 controller.go:104] GRPC request: I1111 20:14:19.600980 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:19.601052 1 controller.go:107] GRPC error: I1111 20:14:19.601065 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:14:19.601072 1 controller.go:104] GRPC request: I1111 20:14:19.601510 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:19.601549 1 controller.go:107] GRPC error: I1111 20:14:19.601572 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:14:19.601587 1 controller.go:104] GRPC request: I1111 20:14:19.601941 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:14:19.601967 1 controller.go:107] GRPC error: I1111 20:14:19.622339 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:14:19.622356 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:14:19.766542 1 controller.go:106] GRPC response: I1111 20:14:19.766597 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:19.766650 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:19.766728 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:14:21.766696991 +0000 UTC m=+95.236713318 (durationBeforeRetry 2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-5f27e90e-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:14:34.595932 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:14:34.596441 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:14:34.596538 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:34.597524 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:14:34.629790 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:14:34.637277 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:14:34.637405 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:34.637441 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:14:34.637534 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:14:34.647036 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:14:34.647058 1 controller.go:104] GRPC request: I1111 20:14:34.647710 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:34.647783 1 controller.go:107] GRPC error: I1111 20:14:34.647807 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:14:34.647814 1 controller.go:104] GRPC request: I1111 20:14:34.648233 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:34.648270 1 controller.go:107] GRPC error: I1111 20:14:34.648289 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:14:34.648296 1 controller.go:104] GRPC request: I1111 20:14:34.648641 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:14:34.648671 1 controller.go:107] GRPC error: I1111 20:14:34.653553 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:14:34.653572 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:14:34.789061 1 controller.go:106] GRPC response: I1111 20:14:34.789215 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:34.789250 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:34.789347 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:14:38.789293747 +0000 UTC m=+112.259310069 (durationBeforeRetry 4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-681d7be0-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:14:34.791754 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b11151789ae default/csi-cephfs-pvc ProvisioningFailed I1111 20:14:36.642296 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:14:36.642432 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:14:49.596256 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:14:49.596776 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:14:49.596950 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:14:49.597037 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:14:49.597809 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:14:49.603485 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:14:49.603547 1 controller.go:104] GRPC request: I1111 20:14:49.604607 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:49.604763 1 controller.go:107] GRPC error: I1111 20:14:49.604799 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:14:49.604817 1 controller.go:104] GRPC request: I1111 20:14:49.606257 1 controller.go:106] GRPC response: capabilities: > I1111 20:14:49.606348 1 controller.go:107] GRPC error: I1111 20:14:49.606381 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:14:49.606396 1 controller.go:104] GRPC request: I1111 20:14:49.607491 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:14:49.607567 1 controller.go:107] GRPC error: I1111 20:14:49.612274 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:14:49.612319 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:14:49.861314 1 controller.go:106] GRPC response: I1111 20:14:49.861506 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:49.861676 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:14:49.861903 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:14:57.861870955 +0000 UTC m=+131.331887294 (durationBeforeRetry 8s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-71081fb2-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:15:04.596705 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:15:04.597070 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:15:04.597340 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:04.598502 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:15:04.614439 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:15:04.619297 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:15:04.619474 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:15:04.619593 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:04.619663 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:15:04.654924 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:15:04.654945 1 controller.go:104] GRPC request: I1111 20:15:04.655544 1 controller.go:106] GRPC response: capabilities: > I1111 20:15:04.655653 1 controller.go:107] GRPC error: I1111 20:15:04.655713 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:15:04.655728 1 controller.go:104] GRPC request: I1111 20:15:04.656222 1 controller.go:106] GRPC response: capabilities: > I1111 20:15:04.656301 1 controller.go:107] GRPC error: I1111 20:15:04.656357 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:15:04.656378 1 controller.go:104] GRPC request: I1111 20:15:04.656863 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:15:04.656902 1 controller.go:107] GRPC error: I1111 20:15:04.659669 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:15:04.659688 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:15:04.801944 1 controller.go:106] GRPC response: I1111 20:15:04.802131 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:15:04.802304 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:15:04.803079 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:15:20.802512194 +0000 UTC m=+154.272528631 (durationBeforeRetry 16s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:15:04.805176 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b181203e7ae default/csi-cephfs-pvc ProvisioningFailed I1111 20:15:06.626914 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:15:06.626970 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:15:19.597145 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:15:19.597373 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:15:19.597553 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:15:19.597612 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:15:04.802512194 +0000 UTC m=+138.272528631. No retries permitted until 2018-11-11 20:15:20.802512194 +0000 UTC m=+154.272528631 (16s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7a000c9a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:15:19.598683 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:15:34.597565 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:15:34.597781 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:15:34.597929 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:34.599094 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:15:34.617741 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:15:34.623865 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:15:34.624003 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:15:34.624017 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:34.624078 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:15:34.694442 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:15:34.694486 1 controller.go:104] GRPC request: I1111 20:15:34.695795 1 controller.go:106] GRPC response: capabilities: > I1111 20:15:34.696146 1 controller.go:107] GRPC error: I1111 20:15:34.696212 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:15:34.696231 1 controller.go:104] GRPC request: I1111 20:15:34.697376 1 controller.go:106] GRPC response: capabilities: > I1111 20:15:34.697456 1 controller.go:107] GRPC error: I1111 20:15:34.697511 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:15:34.697528 1 controller.go:104] GRPC request: I1111 20:15:34.698515 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:15:34.698587 1 controller.go:107] GRPC error: I1111 20:15:34.709587 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:15:34.709608 1 controller.go:104] GRPC request: name:"pvc-51f99106e5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: I1111 20:15:34.845476 1 controller.go:106] GRPC response: I1111 20:15:34.845527 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:15:34.845605 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:15:34.845687 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:16:06.845657508 +0000 UTC m=+200.315673834 (durationBeforeRetry 32s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:15:34.848522 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b1f10bad5ad default/csi-cephfs-pvc ProvisioningFailed I1111 20:15:36.631912 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:15:36.631978 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:15:36.632019 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:15:49.597855 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:15:49.597933 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:15:49.597992 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:15:49.598010 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:15:34.845657508 +0000 UTC m=+168.315673834. No retries permitted until 2018-11-11 20:16:06.845657508 +0000 UTC m=+200.315673834 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-8be94f90-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:15:49.599386 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:15:58.027218 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:58.046356 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:15:58.046381 1 controller.go:1172] operation "lock-provision-default/csi-cephfs-pvc[51f99106-e5ee-11e8-b38a-0ab53650f6d5]" is already running, skipping I1111 20:15:58.075086 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:15:58.075213 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:15:58.075258 1 controller.go:988] claim update received: DELETED default/csi-cephfs-pvc Pending I1111 20:15:58.075269 1 controller.go:999] claim default/csi-cephfs-pvc was deleted E1111 20:15:58.081094 1 leaderelection.go:244] error initially creating leader election record: create not allowed, PVC should already exist I1111 20:15:58.081125 1 leaderelection.go:174] failed to acquire lease to provision for pvc default/csi-cephfs-pvc I1111 20:16:00.314029 1 leaderelection.go:163] stopped trying to acquire lease to provision for pvc default/csi-cephfs-pvc, task succeeded I1111 20:16:04.598166 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:16:04.598183 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:16:04.599679 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:16:16.900539 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:16.941835 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:16:16.948065 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:16:16.948120 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:16.948143 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:16:16.948263 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:16:16.953796 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:16:16.953813 1 controller.go:104] GRPC request: I1111 20:16:16.954429 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:16.954499 1 controller.go:107] GRPC error: I1111 20:16:16.954525 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:16:16.954538 1 controller.go:104] GRPC request: I1111 20:16:16.955108 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:16.955144 1 controller.go:107] GRPC error: I1111 20:16:16.955167 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:16:16.955180 1 controller.go:104] GRPC request: I1111 20:16:16.955590 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:16:16.955622 1 controller.go:107] GRPC error: I1111 20:16:16.960523 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:16:16.960540 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:16:17.085477 1 controller.go:106] GRPC response: I1111 20:16:17.085537 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:17.085587 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:17.085695 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:16:17.585654706 +0000 UTC m=+211.055671053 (durationBeforeRetry 500ms). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a5184dcb-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:16:17.088372 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b28e66e0fe3 default/csi-cephfs-pvc ProvisioningFailed I1111 20:16:18.952797 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:16:18.952852 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:16:18.952879 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:16:19.598508 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:16:19.598627 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:19.598517 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:16:19.598666 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:16:19.600165 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:16:19.600843 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:16:19.600859 1 controller.go:104] GRPC request: I1111 20:16:19.601468 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:19.601536 1 controller.go:107] GRPC error: I1111 20:16:19.601561 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:16:19.601569 1 controller.go:104] GRPC request: I1111 20:16:19.601907 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:19.601945 1 controller.go:107] GRPC error: I1111 20:16:19.601958 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:16:19.601964 1 controller.go:104] GRPC request: I1111 20:16:19.602302 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:16:19.602326 1 controller.go:107] GRPC error: I1111 20:16:19.609876 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:16:19.609894 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:16:19.761569 1 controller.go:106] GRPC response: I1111 20:16:19.761618 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:19.761655 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:19.761763 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:16:20.761732793 +0000 UTC m=+214.231749137 (durationBeforeRetry 1s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a6ac9db1-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:16:34.598816 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:16:34.598824 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:16:34.598956 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:34.599005 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:16:34.600448 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:16:34.604207 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:16:34.604223 1 controller.go:104] GRPC request: I1111 20:16:34.604883 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:34.604948 1 controller.go:107] GRPC error: I1111 20:16:34.604971 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:16:34.604984 1 controller.go:104] GRPC request: I1111 20:16:34.605366 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:34.605409 1 controller.go:107] GRPC error: I1111 20:16:34.605431 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:16:34.605438 1 controller.go:104] GRPC request: I1111 20:16:34.605866 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:16:34.605899 1 controller.go:107] GRPC error: I1111 20:16:34.609430 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:16:34.609448 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:16:34.741664 1 controller.go:106] GRPC response: I1111 20:16:34.741754 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:34.741832 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:34.744124 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:16:36.74203807 +0000 UTC m=+230.212054451 (durationBeforeRetry 2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-af9d4a96-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:16:49.599067 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:16:49.599082 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:16:49.599258 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:49.600617 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:16:49.763996 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:16:49.770747 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:16:49.770762 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:16:49.770949 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:16:49.771039 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:16:49.966275 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:16:49.966300 1 controller.go:104] GRPC request: I1111 20:16:49.966898 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:49.966975 1 controller.go:107] GRPC error: I1111 20:16:49.966997 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:16:49.967005 1 controller.go:104] GRPC request: I1111 20:16:49.967542 1 controller.go:106] GRPC response: capabilities: > I1111 20:16:49.967577 1 controller.go:107] GRPC error: I1111 20:16:49.967604 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:16:49.967611 1 controller.go:104] GRPC request: I1111 20:16:49.968196 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:16:49.968235 1 controller.go:107] GRPC error: I1111 20:16:50.168500 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:16:50.168534 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:16:50.313965 1 controller.go:106] GRPC response: I1111 20:16:50.314011 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:50.314044 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:16:50.314135 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:16:54.314103791 +0000 UTC m=+247.784120119 (durationBeforeRetry 4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b8e3741a-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:16:50.974021 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b30a2ffee8f default/csi-cephfs-pvc ProvisioningFailed I1111 20:16:51.775623 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:16:51.775713 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:17:04.599527 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:17:04.599653 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:17:04.599527 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:17:04.599685 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:17:04.600923 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:17:04.604761 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:17:04.604779 1 controller.go:104] GRPC request: I1111 20:17:04.605352 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:04.605421 1 controller.go:107] GRPC error: I1111 20:17:04.605446 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:17:04.605453 1 controller.go:104] GRPC request: I1111 20:17:04.605910 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:04.605940 1 controller.go:107] GRPC error: I1111 20:17:04.605962 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:17:04.605970 1 controller.go:104] GRPC request: I1111 20:17:04.606331 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:17:04.606360 1 controller.go:107] GRPC error: I1111 20:17:04.617661 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:17:04.617679 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:17:04.757787 1 controller.go:106] GRPC response: I1111 20:17:04.757875 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:04.757972 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:04.758410 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:17:12.758379308 +0000 UTC m=+266.228395636 (durationBeforeRetry 8s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c1804d08-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:17:19.599794 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:17:19.599856 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:17:19.599952 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:17:19.601115 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:17:19.613521 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:17:19.617434 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:17:19.617450 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:17:19.617488 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:17:19.617509 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:17:19.693433 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:17:19.693453 1 controller.go:104] GRPC request: I1111 20:17:19.694120 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:19.694206 1 controller.go:107] GRPC error: I1111 20:17:19.694219 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:17:19.694226 1 controller.go:104] GRPC request: I1111 20:17:19.694691 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:19.694739 1 controller.go:107] GRPC error: I1111 20:17:19.694752 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:17:19.694759 1 controller.go:104] GRPC request: I1111 20:17:19.695106 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:17:19.695133 1 controller.go:107] GRPC error: I1111 20:17:19.730361 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:17:19.730378 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:17:19.872938 1 controller.go:106] GRPC response: I1111 20:17:19.873063 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:19.873254 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:19.873340 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:17:35.873310671 +0000 UTC m=+289.343326995 (durationBeforeRetry 16s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:17:19.875877 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b3784ddb53e default/csi-cephfs-pvc ProvisioningFailed I1111 20:17:21.623850 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:17:21.623924 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:17:21.623951 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:17:34.600119 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:17:34.600143 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:17:34.600259 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:17:34.600287 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:17:19.873310671 +0000 UTC m=+273.343326995. No retries permitted until 2018-11-11 20:17:35.873310671 +0000 UTC m=+289.343326995 (16s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ca823760-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:17:34.601308 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:17:49.600374 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:17:49.600501 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:17:49.600383 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:17:49.601579 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:17:49.617673 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:17:49.621603 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:17:49.623012 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:17:49.623100 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:17:49.623163 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:17:49.628585 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:17:49.628602 1 controller.go:104] GRPC request: I1111 20:17:49.629308 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:49.629410 1 controller.go:107] GRPC error: I1111 20:17:49.629431 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:17:49.629442 1 controller.go:104] GRPC request: I1111 20:17:49.629963 1 controller.go:106] GRPC response: capabilities: > I1111 20:17:49.630011 1 controller.go:107] GRPC error: I1111 20:17:49.630037 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:17:49.630049 1 controller.go:104] GRPC request: I1111 20:17:49.630444 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:17:49.630475 1 controller.go:107] GRPC error: I1111 20:17:49.634695 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:17:49.634713 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:17:49.773922 1 controller.go:106] GRPC response: I1111 20:17:49.773968 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:49.774001 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:17:49.774072 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:18:21.774043765 +0000 UTC m=+335.244060091 (durationBeforeRetry 32s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:17:49.800615 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b3e7b16bbe1 default/csi-cephfs-pvc ProvisioningFailed I1111 20:17:51.629902 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:17:51.629982 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:18:04.600687 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:18:04.600687 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:18:04.600831 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:18:04.600854 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:17:49.774043765 +0000 UTC m=+303.244060091. No retries permitted until 2018-11-11 20:18:21.774043765 +0000 UTC m=+335.244060091 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:18:04.601722 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:18:19.601191 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:18:19.601192 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:18:19.601358 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:18:19.601966 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:18:19.618072 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:18:19.622450 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:19.623249 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:19.623345 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:18:19.623368 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:17:49.774043765 +0000 UTC m=+303.244060091. No retries permitted until 2018-11-11 20:18:21.774043765 +0000 UTC m=+335.244060091 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-dc55417c-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:18:21.629733 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:21.629928 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:23.634564 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:23.634992 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:25.639706 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:25.639796 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:27.644677 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:27.645621 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:29.653410 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:29.653410 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:31.658622 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:31.658803 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:33.663591 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:33.663661 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:34.601488 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:18:34.601606 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:18:34.601488 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:18:34.601640 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:18:34.602116 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:18:34.604015 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:18:34.604031 1 controller.go:104] GRPC request: I1111 20:18:34.604730 1 controller.go:106] GRPC response: capabilities: > I1111 20:18:34.604804 1 controller.go:107] GRPC error: I1111 20:18:34.604825 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:18:34.604832 1 controller.go:104] GRPC request: I1111 20:18:34.605200 1 controller.go:106] GRPC response: capabilities: > I1111 20:18:34.605232 1 controller.go:107] GRPC error: I1111 20:18:34.605244 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:18:34.605251 1 controller.go:104] GRPC request: I1111 20:18:34.605627 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:18:34.605684 1 controller.go:107] GRPC error: I1111 20:18:34.614163 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:18:34.614180 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:18:34.744972 1 controller.go:106] GRPC response: I1111 20:18:34.745020 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:18:34.745056 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:18:34.745128 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:19:38.745099779 +0000 UTC m=+412.215116107 (durationBeforeRetry 1m4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:18:34.748169 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b48f392a52e default/csi-cephfs-pvc ProvisioningFailed I1111 20:18:35.668649 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:18:35.668729 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:18:35.668764 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:18:49.601806 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:18:49.602016 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:18:49.602074 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:18:34.745099779 +0000 UTC m=+348.215116107. No retries permitted until 2018-11-11 20:19:38.745099779 +0000 UTC m=+412.215116107 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:18:49.601810 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:18:49.602264 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:19:04.602341 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:19:04.602377 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:19:04.602445 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:19:04.602491 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:19:04.617439 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:19:04.624181 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:04.624288 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:19:04.624312 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:18:34.745099779 +0000 UTC m=+348.215116107. No retries permitted until 2018-11-11 20:19:38.745099779 +0000 UTC m=+412.215116107 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:19:04.624831 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:06.629731 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:06.629784 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:08.634323 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:08.634448 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:10.639212 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:10.639287 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:12.644813 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:12.644923 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:14.652862 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:14.653255 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:16.657961 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:16.658071 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:18.663050 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:18.663124 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:19.602629 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:19:19.602757 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:19:19.602655 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:19:19.602671 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:19:19.602779 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:18:34.745099779 +0000 UTC m=+348.215116107. No retries permitted until 2018-11-11 20:19:38.745099779 +0000 UTC m=+412.215116107 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:19:20.667795 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:20.667812 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:22.672813 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:22.672856 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:24.680020 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:24.680053 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:26.684957 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:26.684987 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:28.689754 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:28.689748 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:30.694533 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:30.694676 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:32.699241 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:32.699721 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:34.602919 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:19:34.602919 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:19:34.602936 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:19:34.603084 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:19:34.603100 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:18:34.745099779 +0000 UTC m=+348.215116107. No retries permitted until 2018-11-11 20:19:38.745099779 +0000 UTC m=+412.215116107 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-f72490f6-e5ee-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:19:34.708548 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:19:34.708559 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:19:34.708640 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:19:49.603183 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:19:49.603197 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:19:49.603210 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:19:49.603332 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:19:49.603370 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:19:49.607995 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:19:49.608013 1 controller.go:104] GRPC request: I1111 20:19:49.608607 1 controller.go:106] GRPC response: capabilities: > I1111 20:19:49.608694 1 controller.go:107] GRPC error: I1111 20:19:49.608713 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:19:49.608720 1 controller.go:104] GRPC request: I1111 20:19:49.609111 1 controller.go:106] GRPC response: capabilities: > I1111 20:19:49.609143 1 controller.go:107] GRPC error: I1111 20:19:49.609156 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:19:49.609162 1 controller.go:104] GRPC request: I1111 20:19:49.609600 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:19:49.609626 1 controller.go:107] GRPC error: I1111 20:19:49.617320 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:19:49.617339 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:19:49.769911 1 controller.go:106] GRPC response: I1111 20:19:49.769959 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:19:49.770000 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:19:49.770068 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:20:00.579516 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: Watch close - *v1.PersistentVolume total 0 items received I1111 20:20:04.603419 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:20:04.603425 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:20:04.603436 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:20:04.603614 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:20:04.619379 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:20:04.622907 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:04.624068 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:04.624176 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:20:04.624205 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:20:06.631190 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:06.631396 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:08.635384 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:08.635617 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:10.642241 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:10.642512 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:12.647010 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:12.647089 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:14.652722 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:14.653418 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:16.658466 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:16.658642 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:18.662951 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:18.663111 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:19.603757 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:20:19.603772 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:20:19.603779 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:20:19.603954 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:20:19.603984 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:20:20.669888 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:20.669928 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:22.676075 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:22.676711 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:24.681448 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:24.681572 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:26.685811 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:26.685889 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:28.691117 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:28.691156 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:30.698114 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:30.698132 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:32.703232 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:32.703232 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:20:34.603997 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:20:34.604004 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:20:34.604010 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:20:34.604182 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:20:34.604398 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:20:34.707684 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:20:34.707741 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:20:49.604456 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:20:49.604490 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:20:49.604456 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:20:49.604582 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:20:49.604595 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:21:04.604755 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:21:04.604755 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:21:04.604904 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:21:04.604776 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:21:04.631940 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:21:04.649810 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:04.649896 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:21:04.649910 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:21:04.650074 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:06.654427 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:06.654429 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:08.576205 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: Watch close - *v1.PersistentVolumeClaim total 68 items received I1111 20:21:08.659314 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:08.659477 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:10.667665 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:10.667715 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:12.673073 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:12.673166 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:14.679731 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:14.679773 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:16.685822 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:16.685903 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:18.691461 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:18.691541 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:19.605120 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:21:19.605121 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:21:19.605294 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:21:19.605340 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:21:19.605370 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:21:20.701799 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:20.701854 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:22.707719 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:22.707737 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:24.714667 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:24.714678 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:26.720251 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:26.720566 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:28.725236 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:28.725386 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:30.736798 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:30.736814 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:32.742143 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:32.742264 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:34.605460 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:21:34.605485 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:21:34.605501 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:21:34.605709 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:21:34.605724 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:21:34.750320 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:21:34.750325 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:21:34.750405 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:21:49.605972 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:21:49.606123 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:21:49.606145 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:19:49.77004023 +0000 UTC m=+423.240056556. No retries permitted until 2018-11-11 20:21:51.77004023 +0000 UTC m=+545.240056556 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-23d925b0-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:21:49.605972 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:21:49.605973 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:22:04.606501 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:22:04.606502 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:22:04.606551 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:22:04.606832 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:22:04.624117 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:22:04.628521 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:04.628554 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:04.628584 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:22:04.628618 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:22:04.634874 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:22:04.634890 1 controller.go:104] GRPC request: I1111 20:22:04.635939 1 controller.go:106] GRPC response: capabilities: > I1111 20:22:04.636027 1 controller.go:107] GRPC error: I1111 20:22:04.636041 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:22:04.636047 1 controller.go:104] GRPC request: I1111 20:22:04.636448 1 controller.go:106] GRPC response: capabilities: > I1111 20:22:04.636487 1 controller.go:107] GRPC error: I1111 20:22:04.636513 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:22:04.636520 1 controller.go:104] GRPC request: I1111 20:22:04.636818 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:22:04.636858 1 controller.go:107] GRPC error: I1111 20:22:04.694513 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:22:04.694535 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:22:04.826571 1 controller.go:106] GRPC response: I1111 20:22:04.826682 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:22:04.826832 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:22:04.826935 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:22:04.829781 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662b79dd6dd869 default/csi-cephfs-pvc ProvisioningFailed I1111 20:22:06.635254 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:06.635313 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:22:19.606869 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:22:19.606869 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:22:19.606992 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:22:19.606883 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync E1111 20:22:19.607006 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:22:31.573194 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: Watch close - *v1.StorageClass total 1 items received I1111 20:22:34.607211 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:22:34.607249 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:22:34.607220 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:22:34.607335 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:22:34.621814 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:22:34.626176 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:34.626376 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:22:34.626391 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:22:34.626674 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:36.631685 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:36.632622 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:38.639730 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:38.639746 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:40.644302 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:40.644531 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:42.652900 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:42.653898 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:44.658854 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:44.658890 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:46.664077 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:46.664197 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:48.668658 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:48.668688 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:49.607491 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:22:49.607526 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:22:49.607491 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:22:49.607615 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:22:49.607634 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:22:50.673495 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:50.673516 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:52.680306 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:52.680499 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:54.685280 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:54.685457 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:56.691156 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:22:56.691162 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:58.696307 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:22:58.697463 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:00.703736 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:00.703853 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:02.710935 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:02.711089 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:04.607729 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:23:04.607729 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:23:04.607855 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:23:04.607739 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync E1111 20:23:04.607872 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:23:04.716049 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:04.716082 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:04.716156 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:23:19.608015 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:23:19.608015 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:23:19.608143 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:23:19.608015 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:23:19.608157 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:23:34.608396 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:23:34.608427 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:23:34.608555 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:23:34.608395 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:23:34.627103 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:23:34.638864 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:34.638955 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:23:34.638977 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending E1111 20:23:34.638977 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:23:36.644242 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:36.644549 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:38.650192 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:38.650404 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:40.655035 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:40.655289 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:42.661313 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:42.661331 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:44.667479 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:44.667552 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:46.672660 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:46.672696 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:48.677739 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:48.677739 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:49.608763 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:23:49.608876 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:23:49.608763 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:23:49.608771 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:23:49.608899 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:23:50.682275 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:50.682336 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:52.687253 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:52.687384 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:54.694107 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:54.694338 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:56.698903 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:23:56.699031 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:58.703543 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:23:58.703998 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:00.708483 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:00.709339 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:02.713927 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:02.714110 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:04.609139 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:24:04.609160 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:24:04.609372 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:24:04.609394 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:22:04.826901476 +0000 UTC m=+558.296917817. No retries permitted until 2018-11-11 20:24:06.826901476 +0000 UTC m=+680.296917817 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-745c5c7c-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:24:04.609170 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:24:04.723293 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:04.723738 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:04.723791 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:24:19.609483 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:24:19.609571 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:24:19.609497 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:24:19.609661 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:24:19.609711 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:24:19.614414 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:24:19.614453 1 controller.go:104] GRPC request: I1111 20:24:19.615667 1 controller.go:106] GRPC response: capabilities: > I1111 20:24:19.615826 1 controller.go:107] GRPC error: I1111 20:24:19.615857 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:24:19.615872 1 controller.go:104] GRPC request: I1111 20:24:19.616566 1 controller.go:106] GRPC response: capabilities: > I1111 20:24:19.616659 1 controller.go:107] GRPC error: I1111 20:24:19.616734 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:24:19.616752 1 controller.go:104] GRPC request: I1111 20:24:19.617359 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:24:19.617388 1 controller.go:107] GRPC error: I1111 20:24:19.777068 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:24:19.777087 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:24:19.933990 1 controller.go:106] GRPC response: I1111 20:24:19.934183 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:24:19.934257 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:24:19.934343 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:24:34.609716 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:24:34.609729 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:24:34.609716 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:24:34.609871 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:24:34.650107 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:24:34.654352 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:34.655081 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:34.655162 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:24:34.655178 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:24:36.661774 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:36.661982 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:38.666290 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:38.666337 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:40.673710 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:40.673822 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:42.678724 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:42.678741 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:44.685845 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:44.685857 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:46.691252 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:46.691327 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:48.696789 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:48.696841 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:49.610026 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:24:49.610026 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:24:49.610045 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:24:49.610153 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:24:49.610169 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:24:50.701827 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:50.701866 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:52.707038 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:52.707048 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:54.714014 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:54.714599 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:56.719330 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:56.719519 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:24:58.724256 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:24:58.724543 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:00.729211 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:00.729787 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:02.734459 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:02.734556 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:04.610290 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:25:04.610271 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:25:04.610324 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:25:04.610456 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:25:04.610480 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:25:04.741484 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:04.741497 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:04.741567 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:25:19.610600 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:25:19.610600 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:25:19.610723 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:25:19.610744 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:25:19.610618 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:25:34.610915 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:25:34.610925 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:25:34.610921 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:25:34.611057 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:25:34.626395 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:25:34.633688 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:34.633785 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:25:34.633816 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:25:34.634058 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:36.638317 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:36.638547 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:38.642654 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:38.643000 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:40.668373 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:40.668746 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:42.673893 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:42.673993 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:44.688424 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:44.688428 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:46.693632 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:46.694004 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:48.699021 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:48.699035 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:49.611220 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:25:49.611218 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:25:49.611236 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:25:49.611364 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:25:49.611421 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:25:50.704314 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:50.705158 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:52.711059 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:52.711155 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:54.718494 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:54.718625 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:56.724068 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:56.724259 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:25:58.729101 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:25:58.729281 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:00.749370 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:00.749385 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:26:02.759518 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:26:02.759593 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:04.611599 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:26:04.611628 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:26:04.611606 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:26:04.611697 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:26:04.611710 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:26:04.768940 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:26:04.768974 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:04.769092 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:26:19.612012 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:26:19.612197 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:26:19.612289 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:24:19.934312134 +0000 UTC m=+693.404328457. No retries permitted until 2018-11-11 20:26:21.934312134 +0000 UTC m=+815.404328457 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c4e040e3-e5ef-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:26:19.612036 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:26:19.612038 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:26:24.575956 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: Watch close - *v1.PersistentVolume total 0 items received I1111 20:26:34.612327 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:26:34.612471 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:26:34.612582 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:26:34.612642 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:26:34.627372 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:26:34.630447 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:34.630508 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:26:34.630528 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:26:34.630613 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:26:34.651118 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:26:34.651136 1 controller.go:104] GRPC request: I1111 20:26:34.652359 1 controller.go:106] GRPC response: capabilities: > I1111 20:26:34.652430 1 controller.go:107] GRPC error: I1111 20:26:34.652451 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:26:34.652462 1 controller.go:104] GRPC request: I1111 20:26:34.652819 1 controller.go:106] GRPC response: capabilities: > I1111 20:26:34.652854 1 controller.go:107] GRPC error: I1111 20:26:34.652882 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:26:34.652890 1 controller.go:104] GRPC request: I1111 20:26:34.653247 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:26:34.653288 1 controller.go:107] GRPC error: I1111 20:26:34.672733 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:26:34.672750 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:26:34.801749 1 controller.go:106] GRPC response: I1111 20:26:34.801799 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:26:34.801835 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:26:34.801928 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:26:34.805755 1 controller.go:1010] claim event received: MODIFIED default/csi-cephfs-pvc.15662b79dd6dd869 default/csi-cephfs-pvc ProvisioningFailed I1111 20:26:36.637371 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:26:36.637447 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:26:36.637479 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:26:49.612817 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:26:49.612818 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:26:49.613109 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:26:49.613161 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:26:49.612856 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:27:04.613078 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:27:04.613160 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:27:04.613235 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:27:04.613443 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:27:04.635731 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:27:04.640800 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:04.640820 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:04.640856 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:27:04.640871 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:27:06.647958 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:06.647990 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:08.652608 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:08.652742 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:10.658905 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:10.659118 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:12.663994 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:12.664371 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:13.570699 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: Watch close - *v1.PersistentVolumeClaim total 87 items received I1111 20:27:14.672166 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:14.672736 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:16.677559 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:16.677764 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:18.683203 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:18.683334 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:19.613336 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:27:19.613337 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:27:19.613529 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:27:19.613547 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:27:19.613613 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:27:20.688601 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:20.688659 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:22.694053 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:22.694302 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:24.701500 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:24.701550 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:26.705735 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:26.705832 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:28.710614 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:28.710839 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:30.715366 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:30.715417 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:32.721335 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:32.721561 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:34.613584 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:27:34.613686 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:27:34.613601 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:27:34.613748 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:27:34.613700 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:27:34.737681 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:27:34.737719 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:27:34.737741 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:27:49.613850 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:27:49.614007 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:27:49.613903 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:27:49.613906 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync E1111 20:27:49.614037 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:28:04.614217 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:28:04.614255 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:28:04.614241 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:28:04.614339 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:28:04.635188 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:28:04.646167 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:04.646176 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:04.646258 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:28:04.646286 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:28:06.652496 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:06.652623 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:08.657636 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:08.657663 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:10.662296 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:10.662783 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:12.668042 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:12.668088 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:14.675282 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:14.675622 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:16.681335 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:16.681360 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:18.687370 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:18.687388 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:19.614433 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:28:19.614481 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:28:19.614449 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:28:19.614542 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:28:19.614556 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:28:20.693758 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:20.693842 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:22.698722 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:22.698851 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:24.707206 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:24.707216 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:26.711923 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:26.711997 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:28.717897 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:28.717933 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:30.724628 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:30.724709 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:32.730354 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:32.730547 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:34.614755 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:28:34.614785 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:28:34.614755 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:28:34.614851 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:28:34.614872 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:26:34.801897215 +0000 UTC m=+828.271913557. No retries permitted until 2018-11-11 20:28:36.801897215 +0000 UTC m=+950.271913557 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1547b095-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:28:34.740405 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:28:34.740949 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:28:34.740978 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:28:49.615048 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:28:49.615089 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:28:49.615105 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:28:49.615152 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:28:49.615202 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:28:49.619832 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:28:49.619852 1 controller.go:104] GRPC request: I1111 20:28:49.620646 1 controller.go:106] GRPC response: capabilities: > I1111 20:28:49.620745 1 controller.go:107] GRPC error: I1111 20:28:49.620784 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:28:49.620798 1 controller.go:104] GRPC request: I1111 20:28:49.621273 1 controller.go:106] GRPC response: capabilities: > I1111 20:28:49.621309 1 controller.go:107] GRPC error: I1111 20:28:49.621323 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:28:49.621329 1 controller.go:104] GRPC request: I1111 20:28:49.621722 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:28:49.621819 1 controller.go:107] GRPC error: I1111 20:28:49.634188 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:28:49.634210 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:28:49.774476 1 controller.go:106] GRPC response: I1111 20:28:49.774721 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:28:49.774935 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:28:49.775344 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:29:04.615373 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:29:04.615401 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:29:04.615997 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:29:04.615468 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:29:04.634813 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:29:04.641009 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:04.641487 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:04.641566 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:29:04.641593 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:29:06.648349 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:06.648539 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:08.653161 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:08.653323 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:10.659326 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:10.659827 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:12.664566 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:12.664692 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:14.672180 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:14.672276 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:16.677228 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:16.677396 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:18.682778 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:18.682856 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:19.570742 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: Watch close - *v1.StorageClass total 0 items received I1111 20:29:19.615975 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:29:19.616016 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:29:19.616271 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:29:19.616310 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:29:19.616500 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:29:20.687013 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:20.687074 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:22.692352 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:22.693860 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:24.701075 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:24.701194 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:26.707504 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:26.707515 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:28.713386 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:28.713420 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:30.718570 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:30.718587 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:32.723424 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:32.723561 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:34.616260 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:29:34.616373 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:29:34.616387 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:29:34.616260 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:29:34.616688 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:29:34.730412 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:29:34.730421 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:29:34.730474 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:29:49.616566 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:29:49.616566 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:29:49.616731 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:29:49.616752 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:29:49.616843 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:30:04.616836 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:30:04.616836 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:30:04.616960 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:30:04.617006 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:30:04.633528 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:30:04.641364 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:04.641447 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:04.641529 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:30:04.641555 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:30:06.646402 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:06.646561 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:08.696404 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:08.696417 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:10.701525 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:10.701525 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:12.706607 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:12.707008 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:14.713892 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:14.713954 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:16.719141 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:16.719157 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:18.724215 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:18.724254 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:19.617100 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:30:19.617111 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:30:19.617123 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:30:19.617335 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:30:19.617355 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:30:20.729792 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:20.729870 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:22.735724 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:22.735719 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:24.742648 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:24.742803 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:26.747534 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:26.747682 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:28.753452 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:28.753565 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:30.758546 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:30.758561 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:32.763592 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:32.763615 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:34.617418 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:30:34.617418 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:30:34.617435 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:30:34.617608 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:30:34.617624 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:30:34.772756 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:30:34.772885 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:30:34.773522 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:30:49.617667 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:30:49.617680 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:30:49.617703 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:30:49.617940 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:30:49.617963 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:28:49.775209995 +0000 UTC m=+963.245226991. No retries permitted until 2018-11-11 20:30:51.775209995 +0000 UTC m=+1085.245226991 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-65b92c87-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:31:04.619974 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:31:04.621749 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:31:04.621732 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:31:04.622020 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:31:04.637543 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:31:04.641686 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:04.642365 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:04.642425 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:31:04.642449 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:31:04.788195 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:31:04.788216 1 controller.go:104] GRPC request: I1111 20:31:04.789069 1 controller.go:106] GRPC response: capabilities: > I1111 20:31:04.789168 1 controller.go:107] GRPC error: I1111 20:31:04.789189 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:31:04.789196 1 controller.go:104] GRPC request: I1111 20:31:04.789661 1 controller.go:106] GRPC response: capabilities: > I1111 20:31:04.789700 1 controller.go:107] GRPC error: I1111 20:31:04.789713 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:31:04.789720 1 controller.go:104] GRPC request: I1111 20:31:04.790149 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:31:04.790177 1 controller.go:107] GRPC error: I1111 20:31:04.814540 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:31:04.814559 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:31:04.984729 1 controller.go:106] GRPC response: I1111 20:31:04.984777 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:31:04.984809 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:31:04.984883 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:31:06.649208 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:06.649279 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:08.654222 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:08.654330 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:10.659942 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:10.659942 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:12.667003 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:12.667774 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:14.674590 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:14.674779 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:16.680274 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:16.680274 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:18.685282 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:18.685332 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:19.622105 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:31:19.622095 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:31:19.622122 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:31:19.622227 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:31:19.622286 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:31:20.705729 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:20.705761 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:22.712750 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:22.712902 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:24.719374 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:24.719739 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:26.725390 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:26.725669 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:28.730666 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:28.730730 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:30.734941 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:30.734994 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:32.740806 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:32.741034 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:34.622463 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:31:34.622492 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:31:34.622463 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:31:34.622560 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:31:34.622605 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:31:34.748066 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:31:34.748113 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:31:34.748116 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:31:49.622818 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:31:49.622928 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:31:49.622846 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:31:49.623198 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:31:49.623223 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:32:04.623237 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:32:04.623237 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:32:04.623250 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:32:04.623390 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:32:04.638829 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:32:04.644095 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:04.644222 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:32:04.644225 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending E1111 20:32:04.644239 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:32:06.649166 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:06.649217 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:08.654560 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:08.654560 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:10.661277 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:10.661422 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:12.666779 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:12.666834 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:14.673980 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:14.674465 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:16.680111 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:16.681373 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:18.687807 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:18.687852 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:19.623509 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:32:19.623538 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:32:19.623548 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:32:19.623828 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:32:19.623851 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:32:20.693293 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:20.693318 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:22.698132 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:22.698234 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:24.705759 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:24.705781 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:26.711797 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:26.711797 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:28.716487 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:28.716602 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:30.720816 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:30.720890 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:32.725856 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:32.725977 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:32:34.623827 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:32:34.623855 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:32:34.623911 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:32:34.623959 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:32:34.623986 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:32:34.734395 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:32:34.734428 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:32:49.624070 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:32:49.624113 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:32:49.624153 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:32:49.624195 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] E1111 20:32:49.624212 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:33:04.624319 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:33:04.624444 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:33:04.624319 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:33:04.624343 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:33:04.640879 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:33:04.644575 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:04.644634 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:33:04.644674 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending E1111 20:33:04.644654 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:31:04.984853812 +0000 UTC m=+1098.454870149. No retries permitted until 2018-11-11 20:33:06.984853812 +0000 UTC m=+1220.454870149 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b64c0ca2-e5f0-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:33:06.651041 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:06.651402 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:08.656142 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:08.656313 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:10.661944 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:10.662673 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:12.667396 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:12.667520 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:14.676102 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:14.676351 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:16.681694 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:16.681876 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:18.686989 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:33:18.687485 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:19.624617 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:33:19.624617 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:33:19.624633 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:33:19.624766 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]] I1111 20:33:19.624809 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:33:19.634819 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:33:19.634837 1 controller.go:104] GRPC request: I1111 20:33:19.635474 1 controller.go:106] GRPC response: capabilities: > I1111 20:33:19.635546 1 controller.go:107] GRPC error: I1111 20:33:19.635566 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:33:19.635573 1 controller.go:104] GRPC request: I1111 20:33:19.636027 1 controller.go:106] GRPC response: capabilities: > I1111 20:33:19.636156 1 controller.go:107] GRPC error: I1111 20:33:19.636260 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:33:19.636274 1 controller.go:104] GRPC request: I1111 20:33:19.636722 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:33:19.636758 1 controller.go:107] GRPC error: I1111 20:33:19.644494 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:33:19.644510 1 controller.go:104] GRPC request: name:"pvc-9cf82ebfe5ee11e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:33:19.769417 1 controller.go:106] GRPC response: I1111 20:33:19.769469 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:33:19.769504 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:33:19.769579 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[9cf82ebf-e5ee-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:35:21.769549774 +0000 UTC m=+1355.239566100 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-06a97aa2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:33:20.691951 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:20.692231 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending E1111 20:33:20.692261 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim I1111 20:33:20.692273 1 controller.go:994] claim default/csi-cephfs-pvc was modified to not ask for this provisioner I1111 20:33:22.697032 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:33:22.697135 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task succeeded I1111 20:33:34.624994 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:33:34.624995 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:33:34.625007 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync E1111 20:33:34.625108 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim I1111 20:33:49.625362 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:33:49.625453 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:33:49.625515 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:33:49.625565 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim I1111 20:34:04.625765 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:34:04.625758 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:34:04.625796 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync E1111 20:34:04.625913 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim E1111 20:34:09.034456 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim E1111 20:34:09.039136 1 controller.go:638] Exceeded failedProvisionThreshold threshold: 15, for claim "default/csi-cephfs-pvc", provisioner will not attempt retries for this claim I1111 20:34:16.882786 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:16.923599 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:34:16.928793 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:34:16.928992 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:16.929069 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:34:16.929096 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:34:16.935801 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:34:16.935818 1 controller.go:104] GRPC request: I1111 20:34:16.936769 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:16.937028 1 controller.go:107] GRPC error: I1111 20:34:16.937125 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:34:16.937133 1 controller.go:104] GRPC request: I1111 20:34:16.937729 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:16.937819 1 controller.go:107] GRPC error: I1111 20:34:16.937854 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:34:16.937870 1 controller.go:104] GRPC request: I1111 20:34:16.938898 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:34:16.938938 1 controller.go:107] GRPC error: I1111 20:34:16.947166 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:34:16.947193 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:34:17.097234 1 controller.go:106] GRPC response: I1111 20:34:17.097283 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:17.097318 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:17.097404 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:34:17.597372725 +0000 UTC m=+1291.067389049 (durationBeforeRetry 500ms). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-28d133c7-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:34:17.100424 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c245c251d76 default/csi-cephfs-pvc ProvisioningFailed I1111 20:34:18.933793 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:34:18.933870 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:34:19.626103 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:34:19.626108 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:34:19.626130 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:34:19.626293 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:19.626335 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:34:19.628548 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:34:19.628571 1 controller.go:104] GRPC request: I1111 20:34:19.629355 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:19.629441 1 controller.go:107] GRPC error: I1111 20:34:19.629463 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:34:19.629472 1 controller.go:104] GRPC request: I1111 20:34:19.629925 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:19.629958 1 controller.go:107] GRPC error: I1111 20:34:19.629982 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:34:19.629990 1 controller.go:104] GRPC request: I1111 20:34:19.630486 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:34:19.630518 1 controller.go:107] GRPC error: I1111 20:34:19.665484 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:34:19.665504 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:34:19.793113 1 controller.go:106] GRPC response: I1111 20:34:19.793177 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:19.793216 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:19.793329 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:34:20.793279404 +0000 UTC m=+1294.263295728 (durationBeforeRetry 1s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-2a6ffdcf-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:34:34.626520 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:34:34.626517 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:34:34.626538 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:34:34.626639 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:34.626683 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:34:34.631933 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:34:34.631951 1 controller.go:104] GRPC request: I1111 20:34:34.633113 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:34.633265 1 controller.go:107] GRPC error: I1111 20:34:34.633319 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:34:34.633339 1 controller.go:104] GRPC request: I1111 20:34:34.634058 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:34.634106 1 controller.go:107] GRPC error: I1111 20:34:34.634141 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:34:34.634153 1 controller.go:104] GRPC request: I1111 20:34:34.634815 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:34:34.634870 1 controller.go:107] GRPC error: I1111 20:34:34.647850 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:34:34.647864 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:34:34.789710 1 controller.go:106] GRPC response: I1111 20:34:34.789762 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:34.789797 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:34.789885 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:34:36.789852829 +0000 UTC m=+1310.259869152 (durationBeforeRetry 2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-335e27bb-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:34:49.626957 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:34:49.627042 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:34:49.626999 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:34:49.627184 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:49.650060 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:34:49.658831 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:34:49.658885 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:34:49.658904 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:34:49.659094 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:34:49.681713 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:34:49.681746 1 controller.go:104] GRPC request: I1111 20:34:49.683182 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:49.683302 1 controller.go:107] GRPC error: I1111 20:34:49.683316 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:34:49.683324 1 controller.go:104] GRPC request: I1111 20:34:49.684215 1 controller.go:106] GRPC response: capabilities: > I1111 20:34:49.684263 1 controller.go:107] GRPC error: I1111 20:34:49.684305 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:34:49.684319 1 controller.go:104] GRPC request: I1111 20:34:49.685088 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:34:49.685270 1 controller.go:107] GRPC error: I1111 20:34:49.688489 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:34:49.688508 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:34:49.833450 1 controller.go:106] GRPC response: I1111 20:34:49.833502 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:49.833536 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:34:49.833619 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:34:53.833587846 +0000 UTC m=+1327.303604184 (durationBeforeRetry 4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-3c552b6d-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:34:49.837464 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c2bfb600887 default/csi-cephfs-pvc ProvisioningFailed I1111 20:34:51.664211 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:34:51.664272 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:34:51.664297 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:35:04.627307 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:35:04.627333 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:35:04.627440 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:35:04.627487 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:35:04.627505 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:35:04.632004 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:35:04.632021 1 controller.go:104] GRPC request: I1111 20:35:04.632810 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:04.632900 1 controller.go:107] GRPC error: I1111 20:35:04.632946 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:35:04.632973 1 controller.go:104] GRPC request: I1111 20:35:04.633428 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:04.633473 1 controller.go:107] GRPC error: I1111 20:35:04.633505 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:35:04.633518 1 controller.go:104] GRPC request: I1111 20:35:04.633998 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:35:04.634044 1 controller.go:107] GRPC error: I1111 20:35:04.641063 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:35:04.641135 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:35:04.801280 1 controller.go:106] GRPC response: I1111 20:35:04.801318 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:04.801361 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:04.801427 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:35:12.801398694 +0000 UTC m=+1346.271415019 (durationBeforeRetry 8s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-453eb3f5-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:35:06.569010 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: Watch close - *v1.StorageClass total 0 items received I1111 20:35:09.574778 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: Watch close - *v1.PersistentVolume total 0 items received I1111 20:35:19.627606 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:35:19.627613 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:35:19.627629 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:35:19.627785 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:35:19.642413 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:35:19.646135 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:35:19.646191 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:35:19.646256 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:35:19.646413 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:35:19.656204 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:35:19.656223 1 controller.go:104] GRPC request: I1111 20:35:19.657424 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:19.657492 1 controller.go:107] GRPC error: I1111 20:35:19.657513 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:35:19.657520 1 controller.go:104] GRPC request: I1111 20:35:19.657890 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:19.657924 1 controller.go:107] GRPC error: I1111 20:35:19.657942 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:35:19.657949 1 controller.go:104] GRPC request: I1111 20:35:19.658564 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:35:19.658607 1 controller.go:107] GRPC error: I1111 20:35:19.692257 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:35:19.692277 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:35:19.825420 1 controller.go:106] GRPC response: I1111 20:35:19.825491 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:19.825529 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:19.825598 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:35:35.825570237 +0000 UTC m=+1369.295586569 (durationBeforeRetry 16s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:35:19.829126 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c32f70986f4 default/csi-cephfs-pvc ProvisioningFailed I1111 20:35:21.652789 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:35:21.652887 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:35:34.627873 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:35:34.627887 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:35:34.627927 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:35:34.628085 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:35:34.628100 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:35:19.825570237 +0000 UTC m=+1353.295586569. No retries permitted until 2018-11-11 20:35:35.825570237 +0000 UTC m=+1369.295586569 (16s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-4e37533e-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:35:42.567185 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: Watch close - *v1.PersistentVolumeClaim total 113 items received I1111 20:35:49.628249 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:35:49.628272 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:35:49.628250 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:35:49.628370 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:35:49.640712 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:35:49.646695 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:35:49.647110 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:35:49.647179 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:35:49.647203 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:35:49.648612 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:35:49.648631 1 controller.go:104] GRPC request: I1111 20:35:49.649344 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:49.649431 1 controller.go:107] GRPC error: I1111 20:35:49.649451 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:35:49.649462 1 controller.go:104] GRPC request: I1111 20:35:49.649985 1 controller.go:106] GRPC response: capabilities: > I1111 20:35:49.650176 1 controller.go:107] GRPC error: I1111 20:35:49.650221 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:35:49.650233 1 controller.go:104] GRPC request: I1111 20:35:49.650839 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:35:49.650871 1 controller.go:107] GRPC error: I1111 20:35:49.652151 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:35:49.652167 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:35:49.797649 1 controller.go:106] GRPC response: I1111 20:35:49.797819 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:49.797897 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:35:49.797995 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:36:21.797964358 +0000 UTC m=+1415.267980683 (durationBeforeRetry 32s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:35:49.800819 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c39f187de00 default/csi-cephfs-pvc ProvisioningFailed I1111 20:35:51.656801 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:35:51.656876 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:36:04.628608 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:36:04.628608 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:36:04.628643 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:36:04.628926 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:36:04.628951 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:35:49.797964358 +0000 UTC m=+1383.267980683. No retries permitted until 2018-11-11 20:36:21.797964358 +0000 UTC m=+1415.267980683 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:36:19.629028 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:36:19.629130 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:36:19.629146 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:36:19.629164 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:36:19.646574 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:36:19.654291 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:19.654414 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:19.654492 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:36:19.654511 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:35:49.797964358 +0000 UTC m=+1383.267980683. No retries permitted until 2018-11-11 20:36:21.797964358 +0000 UTC m=+1415.267980683 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-6012d452-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:36:21.664374 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:21.664404 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:23.669260 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:23.669350 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:25.674109 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:25.674231 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:27.705634 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:27.705682 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:29.712869 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:29.712910 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:31.719614 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:31.720637 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:33.732551 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:33.732573 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:36:34.629338 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:36:34.629338 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:36:34.629534 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:36:34.629572 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:36:34.629616 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:36:34.631728 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:36:34.631749 1 controller.go:104] GRPC request: I1111 20:36:34.632598 1 controller.go:106] GRPC response: capabilities: > I1111 20:36:34.632670 1 controller.go:107] GRPC error: I1111 20:36:34.632690 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:36:34.632697 1 controller.go:104] GRPC request: I1111 20:36:34.633184 1 controller.go:106] GRPC response: capabilities: > I1111 20:36:34.633353 1 controller.go:107] GRPC error: I1111 20:36:34.633421 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:36:34.633431 1 controller.go:104] GRPC request: I1111 20:36:34.633930 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:36:34.633969 1 controller.go:107] GRPC error: I1111 20:36:34.641938 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:36:34.641968 1 controller.go:104] GRPC request: name:"pvc-264134fbe5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:36:34.769932 1 controller.go:106] GRPC response: I1111 20:36:34.770018 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:36:34.770085 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:36:34.770250 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:37:38.770185228 +0000 UTC m=+1492.240201606 (durationBeforeRetry 1m4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:36:34.774125 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c446a150556 default/csi-cephfs-pvc ProvisioningFailed I1111 20:36:35.737711 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:36:35.737892 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:36:49.629639 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:36:49.629774 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:36:49.629708 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:36:49.629976 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:36:49.630005 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:36:34.770185228 +0000 UTC m=+1428.240201606. No retries permitted until 2018-11-11 20:37:38.770185228 +0000 UTC m=+1492.240201606 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:37:04.630056 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:37:04.630072 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:37:04.630076 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:37:04.630316 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:37:04.644831 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:37:04.650661 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:04.650976 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:04.651050 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:37:04.651072 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:36:34.770185228 +0000 UTC m=+1428.240201606. No retries permitted until 2018-11-11 20:37:38.770185228 +0000 UTC m=+1492.240201606 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:37:06.657542 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:06.657758 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:08.662226 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:08.662227 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:10.667700 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:10.668029 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:10.981204 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:37:10.981251 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[264134fb-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:36:34.770185228 +0000 UTC m=+1428.240201606. No retries permitted until 2018-11-11 20:37:38.770185228 +0000 UTC m=+1492.240201606 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-7ae3bf3f-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:37:10.981203 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:10.992029 1 controller.go:988] claim update received: DELETED default/csi-cephfs-pvc Pending I1111 20:37:10.992056 1 controller.go:999] claim default/csi-cephfs-pvc was deleted E1111 20:37:12.670277 1 leaderelection.go:244] error initially creating leader election record: create not allowed, PVC should already exist E1111 20:37:14.672508 1 leaderelection.go:244] error initially creating leader election record: create not allowed, PVC should already exist E1111 20:37:16.670507 1 leaderelection.go:244] error initially creating leader election record: create not allowed, PVC should already exist E1111 20:37:18.670409 1 leaderelection.go:244] error initially creating leader election record: create not allowed, PVC should already exist I1111 20:37:19.630313 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:37:19.630404 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:37:19.630613 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:37:20.670474 1 leaderelection.go:259] lock is held by and has not yet expired I1111 20:37:20.672459 1 leaderelection.go:259] lock is held by and has not yet expired I1111 20:37:20.672486 1 leaderelection.go:219] failed to renew lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:31.995287 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:37:32.889119 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:37:32.893858 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:32.893869 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:37:32.893909 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:37:32.893928 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:37:33.038175 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:37:33.038195 1 controller.go:104] GRPC request: I1111 20:37:33.039079 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:33.039146 1 controller.go:107] GRPC error: I1111 20:37:33.039161 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:37:33.039168 1 controller.go:104] GRPC request: I1111 20:37:33.039567 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:33.039607 1 controller.go:107] GRPC error: I1111 20:37:33.039619 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:37:33.039626 1 controller.go:104] GRPC request: I1111 20:37:33.040011 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:37:33.040043 1 controller.go:107] GRPC error: I1111 20:37:33.056539 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:37:33.056595 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:37:33.186737 1 controller.go:106] GRPC response: I1111 20:37:33.186809 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:33.186845 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:33.186932 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:37:33.686901629 +0000 UTC m=+1487.156917956 (durationBeforeRetry 500ms). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9db52567-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:37:33.189632 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c5203fdca1e default/csi-cephfs-pvc ProvisioningFailed I1111 20:37:34.631109 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:37:34.631120 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:37:34.631138 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:37:34.631216 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:37:34.631261 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:37:34.633266 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:37:34.633282 1 controller.go:104] GRPC request: I1111 20:37:34.633940 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:34.634011 1 controller.go:107] GRPC error: I1111 20:37:34.634037 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:37:34.634045 1 controller.go:104] GRPC request: I1111 20:37:34.634462 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:34.634497 1 controller.go:107] GRPC error: I1111 20:37:34.634535 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:37:34.634546 1 controller.go:104] GRPC request: I1111 20:37:34.634877 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:37:34.634905 1 controller.go:107] GRPC error: I1111 20:37:34.804382 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:37:34.804408 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:37:34.900556 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:37:34.900684 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:37:34.936810 1 controller.go:106] GRPC response: I1111 20:37:34.936842 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:34.936872 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:34.936951 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:37:35.936909833 +0000 UTC m=+1489.406926159 (durationBeforeRetry 1s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-9ebfca92-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:37:49.631486 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:37:49.631551 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:37:49.631486 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:37:49.631783 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:37:49.631857 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:37:49.637086 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:37:49.637107 1 controller.go:104] GRPC request: I1111 20:37:49.637944 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:49.638206 1 controller.go:107] GRPC error: I1111 20:37:49.638248 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:37:49.638260 1 controller.go:104] GRPC request: I1111 20:37:49.638807 1 controller.go:106] GRPC response: capabilities: > I1111 20:37:49.638845 1 controller.go:107] GRPC error: I1111 20:37:49.638863 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:37:49.638873 1 controller.go:104] GRPC request: I1111 20:37:49.639315 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:37:49.639344 1 controller.go:107] GRPC error: I1111 20:37:49.647443 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:37:49.647498 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:37:49.821177 1 controller.go:106] GRPC response: I1111 20:37:49.821225 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:49.821258 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:37:49.821347 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:37:51.821317098 +0000 UTC m=+1505.291333430 (durationBeforeRetry 2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-a798d098-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:38:04.631838 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:38:04.631945 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:38:04.631838 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:38:04.632067 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:38:04.645843 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:38:04.651051 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:38:04.651303 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:38:04.651379 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:38:04.651413 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:38:04.677650 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:38:04.677699 1 controller.go:104] GRPC request: I1111 20:38:04.678862 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:04.679005 1 controller.go:107] GRPC error: I1111 20:38:04.679089 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:38:04.679183 1 controller.go:104] GRPC request: I1111 20:38:04.680280 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:04.680326 1 controller.go:107] GRPC error: I1111 20:38:04.680347 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:38:04.680354 1 controller.go:104] GRPC request: I1111 20:38:04.680913 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:38:04.680991 1 controller.go:107] GRPC error: I1111 20:38:04.684830 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:38:04.684852 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:38:04.857121 1 controller.go:106] GRPC response: I1111 20:38:04.857291 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:04.857330 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:04.857417 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:38:08.857386193 +0000 UTC m=+1522.327402518 (durationBeforeRetry 4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b08f45c9-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:38:04.860882 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c5963b2f4c0 default/csi-cephfs-pvc ProvisioningFailed I1111 20:38:06.658267 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:38:06.658327 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:38:19.632168 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:38:19.632177 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:38:19.632186 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:38:19.632308 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:38:19.632401 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:38:19.637112 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:38:19.637137 1 controller.go:104] GRPC request: I1111 20:38:19.637781 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:19.637847 1 controller.go:107] GRPC error: I1111 20:38:19.637858 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:38:19.637865 1 controller.go:104] GRPC request: I1111 20:38:19.638238 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:19.638276 1 controller.go:107] GRPC error: I1111 20:38:19.638297 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:38:19.638304 1 controller.go:104] GRPC request: I1111 20:38:19.638705 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:38:19.638743 1 controller.go:107] GRPC error: I1111 20:38:19.663492 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:38:19.663510 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:38:19.785670 1 controller.go:106] GRPC response: I1111 20:38:19.785718 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:19.785753 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:19.785836 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:38:27.785805051 +0000 UTC m=+1541.255821377 (durationBeforeRetry 8s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-b97cbf9a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:38:34.632419 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:38:34.632508 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:38:34.632419 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:38:34.632602 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:38:34.647651 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:38:34.654219 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:38:34.654307 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:38:34.654391 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:38:34.654434 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:38:34.660119 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:38:34.660137 1 controller.go:104] GRPC request: I1111 20:38:34.660880 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:34.660951 1 controller.go:107] GRPC error: I1111 20:38:34.660977 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:38:34.660984 1 controller.go:104] GRPC request: I1111 20:38:34.661438 1 controller.go:106] GRPC response: capabilities: > I1111 20:38:34.661472 1 controller.go:107] GRPC error: I1111 20:38:34.661497 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:38:34.661504 1 controller.go:104] GRPC request: I1111 20:38:34.661860 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:38:34.661922 1 controller.go:107] GRPC error: I1111 20:38:34.672496 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:38:34.672517 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:38:34.812924 1 controller.go:106] GRPC response: I1111 20:38:34.812965 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:34.812998 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:38:34.813065 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:38:50.813035915 +0000 UTC m=+1564.283052243 (durationBeforeRetry 16s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:38:34.815809 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c605d322879 default/csi-cephfs-pvc ProvisioningFailed I1111 20:38:36.661685 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:38:36.661845 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:38:49.632695 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:38:49.632737 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:38:49.632695 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:38:49.632824 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:38:49.632838 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:38:34.813035915 +0000 UTC m=+1548.283052243. No retries permitted until 2018-11-11 20:38:50.813035915 +0000 UTC m=+1564.283052243 (16s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-c26eefa4-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:39:04.632895 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:39:04.632895 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:39:04.632913 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:39:04.633114 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:39:04.652768 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:39:04.658969 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:04.660356 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:04.660418 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:39:04.660455 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:39:04.666722 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:39:04.666778 1 controller.go:104] GRPC request: I1111 20:39:04.667730 1 controller.go:106] GRPC response: capabilities: > I1111 20:39:04.667987 1 controller.go:107] GRPC error: I1111 20:39:04.668063 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:39:04.668077 1 controller.go:104] GRPC request: I1111 20:39:04.668900 1 controller.go:106] GRPC response: capabilities: > I1111 20:39:04.668949 1 controller.go:107] GRPC error: I1111 20:39:04.668980 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:39:04.668999 1 controller.go:104] GRPC request: I1111 20:39:04.669533 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:39:04.669613 1 controller.go:107] GRPC error: I1111 20:39:04.677446 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:39:04.677491 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:39:04.854740 1 controller.go:106] GRPC response: I1111 20:39:04.854833 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:39:04.854928 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:39:04.855125 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:39:36.855019336 +0000 UTC m=+1610.325035724 (durationBeforeRetry 32s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:39:04.858659 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c675bd61451 default/csi-cephfs-pvc ProvisioningFailed I1111 20:39:06.666660 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:06.666894 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:39:19.633137 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:39:19.633178 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:39:19.633143 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:39:19.633290 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:39:19.633307 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:04.855019336 +0000 UTC m=+1578.325035724. No retries permitted until 2018-11-11 20:39:36.855019336 +0000 UTC m=+1610.325035724 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:39:34.633607 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:39:34.633718 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:39:34.634132 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:39:34.633614 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:39:34.649112 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:39:34.653475 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:34.653550 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:39:34.653571 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending E1111 20:39:34.653569 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:04.855019336 +0000 UTC m=+1578.325035724. No retries permitted until 2018-11-11 20:39:36.855019336 +0000 UTC m=+1610.325035724 (32s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-d451663a-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:39:36.658169 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:36.658169 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:38.665192 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:38.665285 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:40.669879 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:40.669888 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:42.674813 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:42.675043 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:44.682882 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:44.683171 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:46.688637 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:46.688683 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:48.693848 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:39:48.694098 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:49.634204 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:39:49.634260 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:39:49.634416 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:39:49.634615 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:39:49.634754 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:39:49.637562 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:39:49.637600 1 controller.go:104] GRPC request: I1111 20:39:49.638819 1 controller.go:106] GRPC response: capabilities: > I1111 20:39:49.639062 1 controller.go:107] GRPC error: I1111 20:39:49.639109 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:39:49.639138 1 controller.go:104] GRPC request: I1111 20:39:49.640375 1 controller.go:106] GRPC response: capabilities: > I1111 20:39:49.640468 1 controller.go:107] GRPC error: I1111 20:39:49.640755 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:39:49.640815 1 controller.go:104] GRPC request: I1111 20:39:49.642081 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:39:49.642158 1 controller.go:107] GRPC error: I1111 20:39:49.647227 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:39:49.647285 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:39:49.841843 1 controller.go:106] GRPC response: I1111 20:39:49.841890 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:39:49.841926 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:39:49.842007 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:40:53.841978485 +0000 UTC m=+1687.311994807 (durationBeforeRetry 1m4s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:39:49.844875 1 controller.go:1010] claim event received: ADDED default/csi-cephfs-pvc.15662c71d544f616 default/csi-cephfs-pvc ProvisioningFailed I1111 20:39:50.699308 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:39:50.699405 1 leaderelection.go:198] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, task failed I1111 20:39:50.699433 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:04.634470 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:40:04.634497 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:40:04.634595 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:40:04.634613 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:49.841978485 +0000 UTC m=+1623.311994807. No retries permitted until 2018-11-11 20:40:53.841978485 +0000 UTC m=+1687.311994807 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:40:04.634796 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:40:19.634839 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:40:19.634839 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:40:19.635014 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:40:19.635110 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:40:19.670948 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:40:19.677678 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:19.677819 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:40:19.677837 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:49.841978485 +0000 UTC m=+1623.311994807. No retries permitted until 2018-11-11 20:40:53.841978485 +0000 UTC m=+1687.311994807 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:40:19.677682 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:21.683441 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:21.684081 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:23.717466 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:23.717538 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:25.731733 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:25.732076 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:27.745408 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:27.745560 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:29.752546 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:29.752619 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:31.757255 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:31.757344 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:33.781863 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:33.782021 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:34.635117 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:40:34.635159 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:40:34.635166 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:40:34.635246 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:40:34.635260 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:49.841978485 +0000 UTC m=+1623.311994807. No retries permitted until 2018-11-11 20:40:53.841978485 +0000 UTC m=+1687.311994807 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:40:35.799655 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:35.799883 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:37.805446 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:37.805567 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:39.812561 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:39.812561 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:41.818748 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:41.819492 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:43.824300 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:43.824424 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:45.831435 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:45.832072 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:47.837602 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:47.837946 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:49.635483 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:40:49.635482 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:40:49.635499 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:40:49.635641 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:40:49.635659 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:39:49.841978485 +0000 UTC m=+1623.311994807. No retries permitted until 2018-11-11 20:40:53.841978485 +0000 UTC m=+1687.311994807 (1m4s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-ef1f53d2-e5f1-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:40:49.848165 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:40:49.848244 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:40:49.848299 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:41:00.574104 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: Watch close - *v1.PersistentVolume total 0 items received I1111 20:41:04.635710 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:41:04.635819 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:41:04.635709 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:41:04.635855 1 controller.go:836] provisionClaimOperation [default/csi-cephfs-pvc] started, class: "csi-cephfs" I1111 20:41:04.636152 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:41:04.637940 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginCapabilities I1111 20:41:04.637958 1 controller.go:104] GRPC request: I1111 20:41:04.638585 1 controller.go:106] GRPC response: capabilities: > I1111 20:41:04.638660 1 controller.go:107] GRPC error: I1111 20:41:04.638675 1 controller.go:103] GRPC call: /csi.v0.Controller/ControllerGetCapabilities I1111 20:41:04.638682 1 controller.go:104] GRPC request: I1111 20:41:04.639106 1 controller.go:106] GRPC response: capabilities: > I1111 20:41:04.639158 1 controller.go:107] GRPC error: I1111 20:41:04.639176 1 controller.go:103] GRPC call: /csi.v0.Identity/GetPluginInfo I1111 20:41:04.639183 1 controller.go:104] GRPC request: I1111 20:41:04.639552 1 controller.go:106] GRPC response: name:"csi-cephfsplugin" vendor_version:"0.3.0" I1111 20:41:04.639591 1 controller.go:107] GRPC error: I1111 20:41:04.650957 1 controller.go:103] GRPC call: /csi.v0.Controller/CreateVolume I1111 20:41:04.650980 1 controller.go:104] GRPC request: name:"pvc-961c2810e5f111e8" capacity_range: volume_capabilities: access_mode: > parameters: parameters: parameters: parameters: parameters: parameters: parameters: controller_create_secrets: controller_create_secrets: controller_create_secrets: controller_create_secrets: I1111 20:41:04.805740 1 controller.go:106] GRPC response: I1111 20:41:04.805788 1 controller.go:107] GRPC error: rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:41:04.805822 1 controller.go:895] Failed to provision volume for claim "default/csi-cephfs-pvc" with StorageClass "csi-cephfs": rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1 cephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported E1111 20:41:04.805906 1 goroutinemap.go:150] Operation for "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]" failed. No retries permitted until 2018-11-11 20:43:06.805874352 +0000 UTC m=+1820.275890678 (durationBeforeRetry 2m2s). Error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported\n" I1111 20:41:19.636106 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:41:19.636106 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:41:19.636327 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:41:19.636434 1 controller.go:1167] scheduleOperation[lock-provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:41:19.654029 1 leaderelection.go:156] attempting to acquire leader lease... I1111 20:41:19.659051 1 leaderelection.go:178] successfully acquired lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:19.659100 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:19.659112 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:41:19.659145 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:41:04.805874352 +0000 UTC m=+1698.275890678. No retries permitted until 2018-11-11 20:43:06.805874352 +0000 UTC m=+1820.275890678 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:41:21.665732 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:21.665752 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:23.670681 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:23.670675 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:25.675789 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:25.675945 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:27.680744 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:27.680939 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:29.689438 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:29.689927 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:31.717919 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:31.717920 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:33.723256 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:33.723784 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:34.636517 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:41:34.636517 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:41:34.636663 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] I1111 20:41:34.636528 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync E1111 20:41:34.636691 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:41:04.805874352 +0000 UTC m=+1698.275890678. No retries permitted until 2018-11-11 20:43:06.805874352 +0000 UTC m=+1820.275890678 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:41:35.729148 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:35.729549 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:36.568119 1 reflector.go:428] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: Watch close - *v1.StorageClass total 0 items received I1111 20:41:37.733880 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:37.733978 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:39.740847 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:39.741367 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:41.745657 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:41.745773 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:43.750335 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:43.750516 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:45.755371 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:45.755477 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:47.778323 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:47.778494 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:49.636766 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:41:49.636833 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:41:49.636761 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:41:49.636952 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:41:49.636967 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:41:04.805874352 +0000 UTC m=+1698.275890678. No retries permitted until 2018-11-11 20:43:06.805874352 +0000 UTC m=+1820.275890678 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported\n". I1111 20:41:49.785816 1 controller.go:988] claim update received: MODIFIED default/csi-cephfs-pvc Pending I1111 20:41:49.785842 1 leaderelection.go:215] succesfully renewed lease to provision for pvc default/csi-cephfs-pvc I1111 20:41:49.785920 1 leaderelection.go:204] stopped trying to renew lease to provision for pvc default/csi-cephfs-pvc, timeout reached I1111 20:42:04.636999 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:497: forcing resync I1111 20:42:04.636999 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:498: forcing resync I1111 20:42:04.637035 1 reflector.go:286] github.com/kubernetes-csi/external-provisioner/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:496: forcing resync I1111 20:42:04.637151 1 controller.go:1167] scheduleOperation[provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]] E1111 20:42:04.637175 1 controller.go:1174] Error scheduling operaion "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]": Failed to create operation with name "provision-default/csi-cephfs-pvc[961c2810-e5f1-11e8-b38a-0ab53650f6d5]". An operation with that name failed at 2018-11-11 20:41:04.805874352 +0000 UTC m=+1698.275890678. No retries permitted until 2018-11-11 20:43:06.805874352 +0000 UTC m=+1820.275890678 (2m2s). Last error: "rpc error: code = Internal desc = cephfs: setfattr failed with following error: exit status 1\ncephfs: setfattr output: setfattr: /var/lib/kubelet/plugins/csi-cephfsplugin/controller/volumes/root-csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc/csi-volumes/csi-cephfs-1bd3d4bc-e5f2-11e8-b5a7-c60474a907dc: Operation not supported\n".