fix: archive dir error

[andyzhangx]

What type of PR is this?
/kind bug

What this PR does / why we need it:
fix: archive dir error

from below error msg, os.Rename is not a sync call, unmount will be called before os.Rename is complete, therefore the os.Rename would fail finally, this PR adds a 2s second before unmount to make sure os.Rename could be completed

[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.770987       1 utils.go:109] GRPC call: /csi.v1.Controller/DeleteVolume
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.771001       1 utils.go:110] GRPC request: {"secrets":"***stripped***","volume_id":"nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive"}
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.771043       1 controllerserver.go:218] DeleteVolume: found mountOptions(nfsvers=4.1) for volume(nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive)
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.771051       1 controllerserver.go:465] internally mounting nfs-server.default.svc.cluster.local:/ at /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.771120       1 nodeserver.go:132] NodePublishVolume: volumeID(nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive) source(nfs-server.default.svc.cluster.local:/) targetPath(/tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6) mountflags([nfsvers=4.1])
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.771137       1 mount_linux.go:218] Mounting cmd (mount) with arguments (-t nfs -o nfsvers=4.1 nfs-server.default.svc.cluster.local:/ /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6)
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.789318       1 nodeserver.go:149] skip chmod on targetPath(/tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6) since mountPermissions is set as 0
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.789338       1 nodeserver.go:151] volume(nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive) mount nfs-server.default.svc.cluster.local:/ on /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6 succeeded
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.789353       1 controllerserver.go:256] archiving subdirectory /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6 --> /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/archived-pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.793519       1 controllerserver.go:480] internally unmounting /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.793536       1 nodeserver.go:172] NodeUnpublishVolume: unmounting volume nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive on /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.793543       1 nodeserver.go:177] force unmount nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive on /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.793663       1 mount_helper_common.go:56] unmounting "/tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6" (corruptedMount: false, mounterCanSkipMountPointChecks: true)
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.793680       1 mount_linux.go:789] Unmounting /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.816473       1 mount_helper_common.go:150] Deleting path "/tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6"
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] I0807 01:47:25.816538       1 nodeserver.go:185] NodeUnpublishVolume: unmount volume nfs-server.default.svc.cluster.local##pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6##archive on /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6 successfully
[pod/csi-nfs-controller-76c9866697-gbwgk/nfs] E0807 01:47:25.816553       1 utils.go:114] GRPC error: rpc error: code = Internal desc = archive subdirectory(/tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6, /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/archived-pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6) failed with rename /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6 /tmp/pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6/archived-pvc-0ad8fba9-dcb2-4106-8887-c4968eb3afd6: no such file or directory

Which issue(s) this PR fixes:

Fixes #595

Special notes for your reviewer:

Does this PR introduce a user-facing change?:

fix: archive dir error

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andyzhangx

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [andyzhangx]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[coveralls]

Pull Request Test Coverage Report for Build 10287049104

Details

• 2 of 2 (100.0%) changed or added relevant lines in 1 file are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage increased (+0.04%) to 78.831%

---

Totals
Change from base Build 10280312227:	0.04%
Covered Lines:	890
Relevant Lines:	1129

---

💛 - Coveralls

[andyzhangx]

/retest

[andyzhangx]

/retest

[andyzhangx]

/retest