Add CSI-Addons NetworkFence support to CephFS

[nixpanic]

Describe the feature you'd like to have

Currently the CSI-Addons NetworkFence operation is implemented for RBD only. It would be great to have CephFS Client Eviction implemented too.

What is the value to the end user? (why is it a priority?)

Faster fail-over in case a workernode malfunctions.

How will we know we have a good solution? (acceptance criteria)

Currently CephFS clients need to time-out before their resources (like file locks) are released. By evicting a client, other workernodes can take over the resources faster.

Additional context

Rook would like to have support for this, see rook/rook#12253 for more details.

Tasks

• add CSI-Addons support to the cephfs provisioner
• include the csi-addons-sidecar in the cephfs provisioner deployment (in Rook)
• implement NetworkFence based on https://docs.ceph.com/en/quincy/cephfs/eviction

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

[riya-singhal31]

Closing this as the CSI work is done.
For Rook, we have the tracker, rook/rook#13201