Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using enable_aws_for_fluentbit = true creates a log group with a suffix but is used without it from the container #341

Open
jpambrun opened this issue Jan 10, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@jpambrun
Copy link

Description

Adding enable_aws_for_fluentbit = true to the configuration does create a log group, /aws/eks/jf-test-cluster/aws-fluentbit-logs-20240110180918467200000001 in my case, but no logs makes it there.

This is not in line with the documentation [1] which states: "Check the list of log groups in the Region. You should see the following: /aws/eks/complete/aws-fluentbit-logs".

Then, looking at the fluenbit container log I see

Log Group /aws/eks/jf-test-cluster/aws-fluentbit-logs not found and `auto_create_group` disabled.     
Failed to send events                                                                              

It looks like there is a disconnect between what is created (i.e. with the suffix) and what is referenced in the configmap (without the suffix)

[OUTPUT]
    Name                  cloudwatch_logs
    Match                 *
    region                us-east-2
    log_group_name        /aws/eks/jf-test-cluster/aws-fluentbit-logs
    log_stream_prefix     fluentbit-log_stream_template   $kubernetes['pod_name'].$kubernetes['container_name']

I don't have any other fluentbit related config, but even specifying a different prefix in aws_for_fluentbit_cw_log_group doesn't help.

[1] https://aws-ia.github.io/terraform-aws-eks-blueprints-addons/main/addons/aws-for-fluentbit/

@askulkarni2 askulkarni2 added the bug Something isn't working label Feb 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Todo
Development

No branches or pull requests

3 participants