Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(collection): add subscriber stack #98

Merged
merged 4 commits into from
Nov 21, 2023
Merged

feat(collection): add subscriber stack #98

merged 4 commits into from
Nov 21, 2023

Conversation

jta
Copy link
Contributor

@jta jta commented Nov 20, 2023

This commit adds the subscriber stack as part of collection. By default nothing is collected. Users can provide either a list of log prefixes or patterns to collect, and can use the wildcard to collect all log groups.

Note that we still won't have the full "out of the box" experience yet as far as cloudwatch logs is concerned. The subscriber is still missing the eventbridge rules which trigger subscription.

Still missing some tests, but this should close the loop with regards to
functionality.
Previously we were treating the absence of patterns or prefixes to
signify "subscribe all". Semantically this is quite confusing once you
try to wire it into cloudformation, where we would like to have the
presence of inputs gate the installation of our app.

This commit adds the ability to support wildcard on either
`logGroupNamePatterns` or `logGroupNamePrefixes`. The subscriber
cloudformation template is adjusted to still subscribe all log groups on
install by default.
It is convenient to create a role that has access to writing to the
firehose we create within our app. We don't necessarily know what
service will be assuming the role however. Gate the creation of such a
role on the user providing a service.
This commit adds the subscriber stack as part of collection. By default
nothing is collected. Users can provide either a list of log prefixes or
patterns to collect, and can use the wildcard to collect all log groups.

Note that we still won't have the full "out of the box" experience yet
as far as cloudwatch logs is concerned. The subscriber is still missing
the eventbridge rules which trigger subscription.
Copy link
Contributor

@obs-gh-colinhutchinson obs-gh-colinhutchinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

more integration tests would be appreciated but fine as is too

Base automatically changed from joao/firehose to main November 21, 2023 15:55
@jta jta merged commit 3e33932 into main Nov 21, 2023
6 checks passed
@jta jta deleted the joao/collection-cfn branch November 21, 2023 16:41
Copy link

🎉 This PR is included in version 1.2.0-beta.7 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Copy link

🎉 This PR is included in version 1.2.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants