Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

E2E: TestEBSVolumeClaim broken #10205

Closed
tgross opened this issue Mar 22, 2021 · 1 comment · Fixed by #10212
Closed

E2E: TestEBSVolumeClaim broken #10205

tgross opened this issue Mar 22, 2021 · 1 comment · Fixed by #10212
Assignees
@tgross
Labels
theme/storage type/bug

Comments

@tgross
Copy link
Member

tgross commented Mar 22, 2021

Failure on nightly end-to-end testing has popped up; this is almost certainly the result of #10158 or #10164 so we'll need to fix this for Nomad 1.1.

=== RUN   TestE2E/CSI/*csi.CSIVolumesTest/TestEBSVolumeClaim
    csi.go:140: 
        	Error Trace:	csi.go:140
        	Error:      	Received unexpected error:
        	            	alloc claim was not released: command nomad [volume status ebs-vol0] failed: exit status 1
        	            	Output: No volumes(s) with prefix or ID "ebs-vol0" found
        	            	
        	            	No volumes(s) with prefix or ID "ebs-vol0" found
        	Test:       	TestE2E/CSI/*csi.CSIVolumesTest/TestEBSVolumeClaim
        	Messages:   	write-ebs alloc claim was not released
    csi.go:260: 
        	Error Trace:	csi.go:260
        	            				framework.go:250
        	            				panic.go:613
        	            				testing.go:742
        	            				csi.go:140
        	Error:      	Received unexpected error:
        	            	alloc claim was not released: command nomad [volume status ebs-vol0] failed: exit status 1
        	            	Output: No volumes(s) with prefix or ID "ebs-vol0" found
        	            	
        	            	No volumes(s) with prefix or ID "ebs-vol0" found
        	Test:       	TestE2E/CSI/*csi.CSIVolumesTest/TestEBSVolumeClaim
        	Messages:   	volume claims were not released
could not deregister volume, dumping allocation logs
--------------------------------------
allocation logs: 23006777-d0ba-d556-43f1-42dee534915f
I0319 05:25:09.612933       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:12.870359       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:12.870718       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:14.653592       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:40.759198       1 controller.go:248] ControllerPublishVolume: called with args {VolumeId:vol-0909ef315fec9346e NodeId:i-07b3aef7068cf6636 VolumeCapability:mount:<> access_mode:<mode:SINGLE_NODE_WRITER >  Readonly:false Secrets:map[] VolumeContext:map[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:44.479300       1 cloud.go:373] AttachVolume volume="vol-0909ef315fec9346e" instance="i-07b3aef7068cf6636" request returned {
  AttachTime: 2021-03-19 05:25:44.472 +0000 UTC,
  Device: "/dev/xvdba",
  InstanceId: "i-07b3aef7068cf6636",
  State: "attaching",
  VolumeId: "vol-0909ef315fec9346e"
}
I0319 05:25:44.656076       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:45.777585       1 manager.go:197] Releasing in-process attachment entry: /dev/xvdba -> volume vol-0909ef315fec9346e
I0319 05:25:45.777608       1 controller.go:290] ControllerPublishVolume: volume vol-0909ef315fec9346e attached to node i-07b3aef7068cf6636 through device /dev/xvdba
I0319 05:25:55.711798       1 controller.go:297] ControllerUnpublishVolume: called with args {VolumeId:vol-0909ef315fec9346e NodeId:i-07b3aef7068cf6636 Secrets:map[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:08.486722       1 controller.go:314] ControllerUnpublishVolume: volume vol-0909ef315fec9346e detached from node i-07b3aef7068cf6636
I0319 05:26:14.657507       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:44.658709       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:14.660590       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:44.661493       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:14.663693       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:44.664796       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:14.666395       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:44.668170       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:14.669883       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:44.671378       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:14.672588       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:44.676390       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

--------------------------------------
allocation logs: 5a0509f4-893f-6bed-96be-b7435cc5fe61
I0319 05:25:08.276491       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:11.556527       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:11.556842       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:13.312377       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:37.335768       1 controller.go:346] ValidateVolumeCapabilities: called with args {VolumeId:vol-0909ef315fec9346e VolumeContext:map[] VolumeCapabilities:[mount:<> access_mode:<mode:SINGLE_NODE_WRITER > ] Parameters:map[] Secrets:map[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:43.313354       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:13.315103       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:43.316377       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:13.317920       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:43.319668       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:13.321768       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:43.323379       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:13.325046       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:43.326549       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:13.327610       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:43.329329       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:13.330447       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:43.332026       1 controller.go:320] ControllerGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

--------------------------------------
allocation logs: 43d4436a-71de-aeb0-db7a-9548473abd19
I0319 05:25:21.041385       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:24.331787       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:24.333583       1 mount_linux.go:163] Cannot run systemd-run, assuming non-systemd OS
I0319 05:25:24.333599       1 mount_linux.go:164] systemd-run failed with: exit status 1
I0319 05:25:24.333626       1 mount_linux.go:165] systemd-run output: Failed to create bus connection: No such file or directory
I0319 05:25:24.333807       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:26.068894       1 node.go:367] NodeGetInfo: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:26.089541       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:56.091224       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:26.092395       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:56.094333       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:26.095264       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:56.096557       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:26.098246       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:56.099918       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:26.102151       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:56.105967       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:26.106888       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:56.108559       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:26.119000       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:56.120748       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

--------------------------------------
allocation logs: 6548b2cb-451f-50a2-b662-850aeadad7d7
I0319 05:25:20.397005       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:23.654851       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:23.658011       1 mount_linux.go:163] Cannot run systemd-run, assuming non-systemd OS
I0319 05:25:23.658042       1 mount_linux.go:164] systemd-run failed with: exit status 1
I0319 05:25:23.658052       1 mount_linux.go:165] systemd-run output: Failed to create bus connection: No such file or directory
I0319 05:25:23.659161       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:25.422136       1 node.go:367] NodeGetInfo: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:25.423587       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:55.424424       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:25.426109       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:55.427609       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:25.428521       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:55.429928       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:25.431655       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:55.432976       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:25.434859       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:55.436685       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:25.438130       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:55.439175       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:25.440543       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:55.441909       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

--------------------------------------
allocation logs: 836f2c47-5e65-bdb2-45fd-51975c0a1f4e
I0319 05:25:10.987325       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:14.251151       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:14.252676       1 mount_linux.go:163] Cannot run systemd-run, assuming non-systemd OS
I0319 05:25:14.252691       1 mount_linux.go:164] systemd-run failed with: exit status 1
I0319 05:25:14.252700       1 mount_linux.go:165] systemd-run output: Failed to create bus connection: No such file or directory
I0319 05:25:14.252863       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:16.012613       1 node.go:367] NodeGetInfo: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:16.014661       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:46.016080       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:16.017007       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:46.018597       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:16.019830       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:46.021224       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:16.023208       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:46.024239       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:16.026456       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:46.028133       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:16.030222       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:46.031341       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:16.033084       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:46.034913       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

--------------------------------------
allocation logs: e407ddfc-db23-4ea9-ae73-f17aef83f6ab
I0319 05:25:11.044156       1 driver.go:68] Driver: ebs.csi.aws.com Version: v0.7.1
W0319 05:25:14.280381       1 metadata.go:136] Failed to parse the outpost arn: 
I0319 05:25:14.282129       1 mount_linux.go:163] Cannot run systemd-run, assuming non-systemd OS
I0319 05:25:14.282141       1 mount_linux.go:164] systemd-run failed with: exit status 1
I0319 05:25:14.282151       1 mount_linux.go:165] systemd-run output: Failed to create bus connection: No such file or directory
I0319 05:25:14.282369       1 driver.go:138] Listening for connections on address: &net.UnixAddr{Name:"/csi/csi.sock", Net:"unix"}
I0319 05:25:16.080898       1 node.go:367] NodeGetInfo: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:16.081690       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:45.790967       1 node.go:96] NodeStageVolume: called with args {VolumeId:vol-0909ef315fec9346e PublishContext:map[devicePath:/dev/xvdba] StagingTargetPath:/csi/staging/ebs-vol[0]/rw-file-system-single-node-writer VolumeCapability:mount:<> access_mode:<mode:SINGLE_NODE_WRITER >  Secrets:map[] VolumeContext:map[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:45.791240       1 node.go:160] NodeStageVolume: find device path /dev/xvdba -> /dev/nvme1n1
I0319 05:25:45.791570       1 node.go:195] NodeStageVolume: formatting /dev/nvme1n1 and mounting at /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer with fstype ext4
I0319 05:25:45.791581       1 mount_linux.go:274] Checking for issues with fsck on disk: /dev/nvme1n1
I0319 05:25:45.818770       1 mount_linux.go:287] `fsck` error fsck from util-linux 2.30.2
fsck.ext2: Bad magic number in super-block while trying to open /dev/nvme1n1
/dev/nvme1n1: 
The superblock could not be read or does not describe a correct ext2
filesystem.  If the device is valid and it really contains an ext2
filesystem (and not swap or ufs or something else), then the superblock
is corrupt, and you might try running e2fsck with an alternate superblock:
    e2fsck -b 8193 <device>

I0319 05:25:45.818789       1 mount_linux.go:293] Attempting to mount disk: ext4 /dev/nvme1n1 /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:45.818803       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-t ext4 -o defaults /dev/nvme1n1 /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer])
E0319 05:25:45.839249       1 mount_linux.go:140] Mount failed: exit status 32
Mounting command: mount
Mounting arguments: -t ext4 -o defaults /dev/nvme1n1 /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer
Output: mount: /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer: wrong fs type, bad option, bad superblock on /dev/nvme1n1, missing codepage or helper program, or other error.

I0319 05:25:45.839281       1 mount_linux.go:346] Attempting to determine if disk "/dev/nvme1n1" is formatted using blkid with args: ([-p -s TYPE -s PTTYPE -o export /dev/nvme1n1])
I0319 05:25:45.851211       1 mount_linux.go:349] Output: "", err: exit status 2
I0319 05:25:45.851241       1 mount_linux.go:322] Disk "/dev/nvme1n1" appears to be unformatted, attempting to format as type: "ext4" with options: [-F -m0 /dev/nvme1n1]
I0319 05:25:46.084507       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:46.990500       1 mount_linux.go:326] Disk successfully formatted (mkfs): ext4 - /dev/nvme1n1 /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:46.990527       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-t ext4 -o defaults /dev/nvme1n1 /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer])
I0319 05:25:47.018926       1 node.go:145] NodeStageVolume: volume="vol-0909ef315fec9346e" operation finished
I0319 05:25:47.019019       1 node.go:147] donedone
I0319 05:25:47.020469       1 node.go:281] NodePublishVolume: called with args {VolumeId:vol-0909ef315fec9346e PublishContext:map[devicePath:/dev/xvdba] StagingTargetPath:/csi/staging/ebs-vol[0]/rw-file-system-single-node-writer TargetPath:/csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer VolumeCapability:mount:<> access_mode:<mode:SINGLE_NODE_WRITER >  Readonly:false Secrets:map[] VolumeContext:map[] XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:47.020525       1 node.go:454] NodePublishVolume: creating dir /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:47.020594       1 node.go:464] NodePublishVolume: mounting /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer at /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer with option [bind] as fstype ext4
I0319 05:25:47.020622       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-t ext4 -o bind /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer])
I0319 05:25:47.022246       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-t ext4 -o bind,remount /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer])
I0319 05:25:55.694910       1 node.go:326] NodeUnpublishVolume: called with args {VolumeId:vol-0909ef315fec9346e TargetPath:/csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:55.694957       1 node.go:337] NodeUnpublishVolume: unmounting /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:55.694964       1 mount_linux.go:202] Unmounting /csi/per-alloc/26ed77b3-fef6-7d71-ffac-b3af69f0281d/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:55.699567       1 node.go:206] NodeUnstageVolume: called with args {VolumeId:vol-0909ef315fec9346e StagingTargetPath:/csi/staging/ebs-vol[0]/rw-file-system-single-node-writer XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:25:55.699862       1 node.go:238] NodeUnstageVolume: unmounting /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:25:55.699881       1 mount_linux.go:202] Unmounting /csi/staging/ebs-vol[0]/rw-file-system-single-node-writer
I0319 05:26:16.086246       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:26:46.088322       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:16.090330       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:27:46.092341       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:16.094218       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:28:46.096017       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:16.097082       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:29:46.098702       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:16.100499       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:30:46.104040       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:16.105369       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}
I0319 05:31:46.107215       1 node.go:351] NodeGetCapabilities: called with args {XXX_NoUnkeyedLiteral:{} XXX_unrecognized:[] XXX_sizecache:0}

    csi.go:267: 
        	Error Trace:	csi.go:267
        	            				framework.go:250
        	            				panic.go:613
        	            				testing.go:742
        	            				csi.go:140
        	Error:      	Received unexpected error:
        	            	command nomad [volume deregister ebs-vol0] failed: exit status 1
        	            	Output: No volumes(s) with prefix or ID "ebs-vol0" found
        	Test:       	TestE2E/CSI/*csi.CSIVolumesTest/TestEBSVolumeClaim
        	Messages:   	No volumes(s) with prefix or ID "ebs-vol0" found
            --- FAIL: TestE2E/CSI/*csi.CSIVolumesTest/TestEBSVolumeClaim (433.96s)
@tgross tgross self-assigned this Mar 22, 2021
@tgross tgross mentioned this issue Mar 22, 2021
Merged
@github-actions
Copy link

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Oct 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@tgross tgross

Labels
theme/storage type/bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

E2E: CSI test should use expected unique-volume name hashicorp/nomad
1 participant
@tgross