Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: Volume health fails because it looks to a wrong path #999

Closed
shanduur-dell opened this issue Oct 10, 2023 · 1 comment · Fixed by dell/csi-powerscale#222
Closed
Assignees
Labels
area/csi-powerscale Issue pertains to the CSI Driver for Dell EMC PowerScale type/bug Something isn't working. This is the default label associated with a bug issue.
Milestone

Comments

@shanduur-dell
Copy link

shanduur-dell commented Oct 10, 2023

Bug Description

User is currently updating to Version 2.8.0 (from v1.4.0) of the CSI-PowerScale Driver as wanted to use Volume Health Monitoring.

They ran into the Problem that the volumeHealthMonitoring feature tries to search the volume on the default isiPath that was defined in isiConfig/Helm Values.

However, this is not where our volumes are.

The volumes are created under the IsiPath in the respective StorageClass.

All StorageClasses in the environment have a custom isiPath.

Logs

time="2023-09-27T15:30:15Z" level=info msg="/csi.v1.Node/NodeGetVolumeStats: REQ 0010: VolumeId=cargo-38718e44be===227922===System, VolumePath=/var/lib/kubelet/pods/2c1a6d43-5588-4e98-8cba-28236fe17d6a/volumes/kubernetes.io~csi/cargo-38718e44be/mount, XXX_NoUnkeyedLiteral={}, XXX_sizecache=0"
time="2023-09-27T15:30:15Z" level=debug runid=10 msg="volume ID 'cargo-38718e44be===227922===System' parsed into volume name 'cargo-38718e44be', export ID '227922', access zone 'System' and cluster name ''" file="/go/src/common/utils/utils.go:364"
time="2023-09-27T15:30:15Z" level=info runid=10 msg="Request doesn't include cluster name. Use default cluster 'eq'" file="/go/src/service/service.go:995"
time="2023-09-27T15:30:15Z" level=debug runid=10 msg="isiSvc already initialized, skip probing" file="/go/src/service/service.go:370"
time="2023-09-27T15:30:15Z" level=debug runid=10 msg="check if volume (id :'cargo-38718e44be', name '') already exists" file="/go/src/service/isiService.go:457"
[DEBUG]
-------------------------- GOISILON HTTP REQUEST -------------------------
GET /namespace/ifs/data/csi/cargo-38718e44be HTTP/1.1
Host: b-stxt-cargo-prod.stor.int:8080
Authorization: csi:******

[DEBUG]
-------------------------- GOISILON HTTP RESPONSE -------------------------
HTTP/1.1 404 Not Found
Transfer-Encoding: chunked
Allow: GET, PUT, POST, DELETE, HEAD
Content-Security-Policy: default-src 'none'
Content-Type: application/json
Date: Wed, 27 Sep 2023 15:30:15 GMT
Server: Apache
Strict-Transport-Security: max-age=31536000;
X-Content-Type-Options: nosniff
time="2023-09-27T15:30:15Z" level=debug runid=10 msg="volume (id :'cargo-38718e44be', name '') already exists : 'false'" file="/go/src/service/isiService.go:461"
time="2023-09-27T15:30:15Z" level=info msg="/csi.v1.Node/NodeGetVolumeStats: REP 0010: VolumeCondition=abnormal:true message:\"volume cargo-38718e44be does not exists at this path /ifs/data/csi\" , XXX_NoUnkeyedLiteral={}, XXX_sizecache=0"
X-Frame-Options: sameorigin
X-Isi-Ifs-Spec-Version: 1.0
X-Xss-Protection: 1; mode=block

[DEBUG] the query of volume (id 'cargo-38718e44be', name 'cargo-38718e44be') returned an error, regard the volume as non-existent. error : 'Unable to open object 'data/csi/cargo-38718e44be' in store 'ifs' – not found.'

Screenshots

No response

Additional Environment Information

No response

Steps to Reproduce

  1. volume exists under diffrent path:
    • /ifs/data/csi/foo/data-38718e44be
  2. storageClass used has isiPath set to:
    • /ifs/data/csi/foo
  3. isiPath in config is left at default:
    • /ifs/data/csi-live

Expected Behavior

Volume Health is reported properly

CSM Driver(s)

CSI Driver for PowerScale v2.8

Installation Type

Helm Chart

Container Storage Modules Enabled

No response

Container Orchestrator

Kubernetes v1.26

Operating System

SLES 15SP4

@shanduur-dell shanduur-dell added needs-triage Issue requires triage. type/bug Something isn't working. This is the default label associated with a bug issue. labels Oct 10, 2023
@shanduur-dell shanduur-dell self-assigned this Oct 10, 2023
@csmbot
Copy link
Collaborator

csmbot commented Oct 10, 2023

@shanduur-dell: Thank you for submitting this issue!

The issue is currently awaiting triage. Please make sure you have given us as much context as possible.

If the maintainers determine this is a relevant issue, they will remove the needs-triage label and assign an appropriate priority label.


We want your feedback! If you have any questions or suggestions regarding our contributing process/workflow, please reach out to us at container.storage.modules@dell.com.

@shanduur-dell shanduur-dell added backlog and removed needs-triage Issue requires triage. labels Oct 10, 2023
@shanduur-dell shanduur-dell added the area/csi-powerscale Issue pertains to the CSI Driver for Dell EMC PowerScale label Oct 10, 2023
@shanduur-dell shanduur-dell added this to the v1.9.0 milestone Oct 10, 2023
@shanduur-dell shanduur-dell linked a pull request Oct 10, 2023 that will close this issue
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/csi-powerscale Issue pertains to the CSI Driver for Dell EMC PowerScale type/bug Something isn't working. This is the default label associated with a bug issue.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants