High CPU / Memory usage using kubernetes_events plugin

[mkatana-silkycoders]

Tested Fluent-bit Version:

• 2.1.8
• 2.1.10 (latest)

Number of namespaces: ~400

First problem

High cpu usage when using plugin kubernetes_events, on left without plugin on right with plugin.

CPU Stats

Memory

Basic example:

    [INPUT]
        name                          kubernetes_events
        tag                           k8s_events
        kube_url                      https://kubernetes.default.svc:443

    [OUTPUT]
        Name                          kafka
        Match                         k8s_events
        Brokers                       kafka:9093
        Topics                        events
        Workers                       3
        rdkafka.compression.codec     gzip
        rdkafka.request.required.acks 1

Second problem

#1

When i set interval_nsec to default from doc events are colleceted and high CPU / Memory usage...

interval_nsec                 500000000

#2

When i set interval_nsec to 10000000000, events are not collected and theres no high CPU / Memory usage

interval_nsec                 10000000000

#3

Wrong default value its not 5 seconds, its 0.5s ?!

#4

When i use: interval_sec 60 events are not collected and no CPU / Memory high usage

[mkatana-silkycoders]

@pwhelan @edsiper @leonardo-albertovich @fujimotos @koleini

probably releated to #7557

[pwhelan]

It might be better to reconsider increasing the interval to 5 seconds as the default. Initially it was even lower, @edsiper?

[github-actions]

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

[github-actions]

This issue was closed because it has been stalled for 5 days with no activity.

[mkatana-silkycoders]

reopen