Important
You can't use dynamic provisioning with Fargate nodes.
This example shows how to create a dynamically provisioned volume created through Amazon EFS access points and a persistent volume claim (PVC) that's consumed by a Pod.
Prerequisite
This example requires Kubernetes 1.17 or later and a driver version of 1.2.0 or later.
-
Create a storage class for Amazon EFS.
-
Retrieve your Amazon EFS file system ID. You can find this in the Amazon EFS console, or use the following AWS CLI command.
aws efs describe-file-systems --query "FileSystems[*].FileSystemId" --output text
The example output is as follows.
fs-582a03f3
-
Download a
StorageClass
manifest for Amazon EFS.curl -O https://raw.githubusercontent.com/kubernetes-sigs/aws-efs-csi-driver/master/examples/kubernetes/dynamic_provisioning/specs/storageclass.yaml
-
Edit the file. Find the following line, and replace the value for
fileSystemId
with your file system ID.fileSystemId: fs-582a03f3
Modify the other values as needed:
provisioningMode
- The type of volume to be provisioned by Amazon EFS. Currently, only access point based provisioning is supported (efs-ap
).fileSystemId
- The file system under which the access point is created.directoryPerms
- The directory permissions of the root directory created by the access point.gidRangeStart
(Optional) - The starting range of the Posix group ID to be applied onto the root directory of the access point. The default value is50000
.gidRangeEnd
(Optional) - The ending range of the Posix group ID. The default value is7000000
.basePath
(Optional) - The path on the file system under which the access point root directory is created. If the path isn't provided, the access points root directory is created under the root of the file system.
-
Deploy the storage class.
kubectl apply -f storageclass.yaml
-
-
Test automatic provisioning by deploying a Pod that makes use of the PVC:
-
Download a manifest that deploys a Pod and a PVC.
curl -O https://raw.githubusercontent.com/kubernetes-sigs/aws-efs-csi-driver/master/examples/kubernetes/dynamic_provisioning/specs/pod.yaml
-
Deploy the Pod with a sample app and the PVC used by the Pod.
kubectl apply -f pod.yaml
-
-
Determine the names of the Pods running the controller.
kubectl get pods -n kube-system | grep efs-csi-controller
The example output is as follows.
efs-csi-controller-74ccf9f566-q5989 3/3 Running 0 40m efs-csi-controller-74ccf9f566-wswg9 3/3 Running 0 40m
-
After few seconds, you can observe the controller picking up the change (edited for readability). Replace
74ccf9f566-q5989
with a value from one of the Pods in your output from the previous command.kubectl logs efs-csi-controller-74ccf9f566-q5989 \ -n kube-system \ -c csi-provisioner \ --tail 10
The example output is as follows.
[...] 1 controller.go:737] successfully created PV pvc-5983ffec-96cf-40c1-9cd6-e5686ca84eca for PVC efs-claim and csi volume name fs-95bcec92::fsap-02a88145b865d3a87
If you don't see the previous output, run the previous command using one of the other controller Pods.
-
Confirm that a persistent volume was created with a status of
Bound
to aPersistentVolumeClaim
:kubectl get pv
The example output is as follows.
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE pvc-5983ffec-96cf-40c1-9cd6-e5686ca84eca 20Gi RWX Delete Bound default/efs-claim efs-sc 7m57s
-
View details about the
PersistentVolumeClaim
that was created.kubectl get pvc
The example output is as follows.
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE efs-claim Bound pvc-5983ffec-96cf-40c1-9cd6-e5686ca84eca 20Gi RWX efs-sc 9m7s
-
View the sample app Pod's status until the
STATUS
becomesRunning
.kubectl get pods -o wide
The example output is as follows.
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES efs-app 1/1 Running 0 10m 192.168.78.156 ip-192-168-73-191.region-code.compute.internal <none> <none>
Note
If a Pod doesn't have an IP address listed, make sure that you added a mount target for the subnet that your node is in (as described at the end of Create an Amazon EFS file system). Otherwise the Pod won't leave ContainerCreating
status. When an IP address is listed, it may take a few minutes for a Pod to reach the Running
status.
-
Confirm that the data is written to the volume.
kubectl exec efs-app -- bash -c "cat data/out"
The example output is as follows.
[...] Tue Mar 23 14:29:16 UTC 2021 Tue Mar 23 14:29:21 UTC 2021 Tue Mar 23 14:29:26 UTC 2021 Tue Mar 23 14:29:31 UTC 2021 [...]
-
(Optional) Terminate the Amazon EKS node that your Pod is running on and wait for the Pod to be re-scheduled. Alternately, you can delete the Pod and redeploy it. Complete the previous step again, confirming that the output includes the previous output.
Note
When you want to delete an access point in a file system when deleting PVC, you should specify elasticfilesystem:ClientRootAccess
to the file system access policy to provide the root permissions.