feat: AWS DynamoDB Ingest (CDC)

[jshlbrd]

Description

• Adds support for AWS DynamoDB ingest
• Updates build/terraform/aws/dynamodb to enable Stream on tables

Motivation and Context

This adds ingest support for DynamoDB Streams and enables change data capture (CDC) use cases. (More info about CDC here.) Some example usage:

• Observability on changes made to tables
• Sending notifications for specific types of changes
• Replicating enrichment data from short-term to long-term storage

DynamoDB is schemaless and records generated by the DynamoDB Stream source aren't structured in a way that makes them easily consumed, so this transforms the records into JSON that is modeled similarly to those used in Debezium.

Since DynamoDB Streams are charged based on reads and not uptime, the Terraform module was updated to always create a Stream that captures old and new changes to each row for every table.

How Has This Been Tested?

Integration tested on a production DynamoDB table.

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.