efs-t-1.2.1
© 2020 Amazon Web Services, Inc. and its affiliates. All rights reserved. This sample code is made available under the MIT-0 license. See the LICENSE file.
Errors or corrections? Email us at darrylo@amazon.com.
These six (6) tutorials are designed to help you better understand the performance characteristics of Amazon Elastic File System (Amazon EFS) and how parallelism, I/O size, and Amazon EC2 instance types affects file system IOPS and throughput.
This tutorial is a set of AWS Cloudformation templates that will create an Amazon EFS file system and pre-load data to grow the file system to obtain higher levels of IOPS and throughput. Throughput and IOPS on Amazon EFS scales as a file system grows, so larger file systems are able to achieve higher levels of throughput and IOPS. Because file-based workloads are typically spiky—driving high levels of throughput for short periods of time, and low levels of throughput the rest of the time—Amazon EFS is designed to burst to high throughput levels for periods of time. Amazon EFS uses a credit system to determine when file systems can burst. File systems can be monitored using AWS CloudWatch metrics. These Cloudformation templates will also create an AWS CloudWatch dashboard, custom metrics, alarms, scheduled events, AWS Lambda function, SNS notification, and an Auto Scaling group to monitor and dynamically adjust alarm thresholds as the file system grows and shrinks.
Click on the 
link below to go to the Create a file system tutorial. Once you've finished that tutorial move on to Performance.
| Tutorial | Link |
|---|---|
| Create a file system |  |
This tutorial is a set of scripts that will demonstrate:
- different instance types provide different levels of network performance when accessing a file system
- different I/O sizes (block sizes) and sync() freqencies (the rate data is persisted to disk) effects file system throughput
- increasing the number of threads accessing a file system will increase IOPS and throughput
Click on the link below to go to the Performance tutorial. Once you've finished that tutorial move on to Scale-out.
| Tutorial | Link |
|---|---|
| Performance | |
This tutorial is a Cloudformation template that will create an Amazon EC2 spot fleet and download objects in parallel from an Amazon S3 bucket.
Click on the link below to go to the Scale-out tutorial. Once you've finished that tutorial move on to the Scenarios.
| Tutorial | Link |
|---|---|
| Scale-out | |
This tutorial is designed to help you better understand how Amazon EFS is performing by using Amazon CloudWatch and Metric Math to monitor file system performance.
Click on the link below to go to the Monitoring tutorial.
| Tutorial | Link |
|---|---|
| Monitoring | |
The AWS DataSync In-cloud Transfer Quick Start and Scheduler creates a one-time or recurring schedule to transfer files between source and destination Amazon EFS file systems. These file systems could be in the same or different AWS regions.
Click on the link below to go to the In-cloud Transfer Quick Start.
| Quick Start | Link |
|---|---|
| In-cloud Transfer | |
This tutorial covers how to use Amazon EFS, a highly available, highly durable and elastic cloud native file storage for Data Science workloads.
Click on the link below to go to the Data science tutorial.
| Tutorial | Link |
|---|---|
| Data science | |
For feedback, suggestions, or corrections, please email me at darrylo@amazon.com.
This sample code is made available under the MIT-0 license. See the LICENSE file.