Release v0.9.1

[jshlbrd]

Substation v0.9.1 has arrived! Read about our changes below:

Continuous Data Processing with Streamers

There is now a third data transformation method, streaming (stream), that supports continuous data processing use cases. Behind the scenes this relies on a concurrency pipeline pattern and enables faster delivery of data plus the ability to process data in persistent or long-lived processes. If you were previously using the batching (batch) transformation method, then you most likely want to update your configs to use streaming instead!

Change Data Capture (CDC) for DynamoDB

Now the project enables CDC for all DynamoDB tables by default, letting users create unique notification and replication systems. More information is available on the docs site.

Pub/Sub Messaging Patterns

The project now supports pub/sub messaging patterns via SNS -- so many uses for this architecture that go beyond security monitoring! Check it out on the docs site.

Other Changes

• Added automated reader support for Zstandard and Snappy compression
  • feat: Add Zstandard & Snappy Readers #105
• Added a benchmarking application
  • feat: Add Benchmark App & No-Op Features #108
• Added a script for rehydrating data from S3
  • build: S3 Rehydration Python Script #99
• Added support for creating and deploying resources in VPCs (cc @ashishpatel-git)
  • build: networking module for custom VPCs #101
• Refactored custom error types (cc @rafaelbreno)
  • refactor: Remove custom error type implementation #103