async-lambda-dynamodb

Asynchronous Integration Test with Lambda Event Listener and DynamoDB

You may use a variety of resource types to create the event listener for your asynchronous system under test (more about event listeners). We recommend starting with AWS Lambda and Amazon DynamoDB. DynamoDB creates a persistent storage resource that can enable long running tests or an aggregation of a set of results.

In this pattern, a Lambda function is configured to be an event listener to receive the System Under Test's output data. DynamoDB is configured to be the event listener storage option. In Step 1 in the diagram below, the test establishes a long polling pattern with DynamoDB. In Step 2, the test sends input data to the asynchronous system under test. The async system processes the data and in Step 3 the the Lambda function receives the data and puts it into DynamoDB. The long poll queries DynamoDB and examines the result. We recommend writing tests for failure conditions including timeouts and malformed requests.

[top]

Review the System Under Test

The System Under Test (SUT) in this example is an asynchronous text processor. It contains a source S3 bucket that receives a text file. A Lambda function is configured to be notified when the putObject event is executed on this bucket. The Lambda function gets the file from the source bucket, transforms the contents of the file to uppercase, then puts the file into a destination S3 bucket.

Your goal is to test this asynchronous process. You will use the Lambda Event Listener and DynamoDB test pattern to test the process. You will deploy the following resources:

• S3 Source Bucket
• Lambda function text processor
• S3 Destination Bucket
• Lambda event listener (test environments only)
• DynamoDB results storage (test environments only)

[top]

Prerequisites

The SAM CLI is an extension of the AWS CLI that adds functionality for building and testing serverless applications. It contains features for building your appcation locally, deploying it to AWS, and emulating AWS services locally to support automated unit tests.

To use the SAM CLI, you need the following tools.

• SAM CLI - Install the SAM CLI
• .NET 8 - Install .NET 8

[top]

Build the project

dotnet build

[top]

Deploy project resources to the cloud

sam build
sam deploy --guided

The deploy process accepts a parameter named DeployTestResources. The allowed values for this parameter are true and false. If you pass true as this parameter's value CloudFormation will attempt to deploy the test event listener and storage resources (Lambda and DynamoDB) to your account. If you pass false these resources will not be deployed.

[top]

Run the tests

Before deploying, ensure you set the two environment variables to the Stack Name and AWS Region used when deploying your resources to the cloud.

Windows

$env:AWS_SAM_STACK_NAME = ""
$env:AWS_SAM_REGION_NAME = ""
dotnet test tests\AsyncTesting.IntegrationTest\AsyncTesting.IntegrationTest.csproj

Linux

export AWS_SAM_STACK_NAME=""
export AWS_SAM_REGION_NAME=""
dotnet test tests/AsyncTesting.IntegrationTest/AsyncTesting.IntegrationTest.csproj

[top]

Cleanup

sam delete

[top]