[netflow]: disable event normalisation

[pkoutsovasilis]

Proposed commit message

This PR introduces the following:

• Disable event normalisation for netflow input
• Adds Kibana service in the docker-compose.yml provisioned for the needs of x-pack/filebeat integration tests
• Extend netflow integration test to install netflow Kibana package and thus prevent similar issues as this one.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Disruptive User Impact

N/A

Author's Checklist

N/A

How to test this PR locally

Related issues

• Closes [Filebeat] Netflow input - disable event normalization #37764

Use cases

N/A

Screenshots

CPU profile with event normalisation enabled:

CPU profile with event normalisation disabled:

As you can see between the two screenshots the "GenericEventConverter" and the respective CPU time are completely gone (~13sec) and instead we have a netflow specific net.IP normalisation beat event function that takes (~2.5sec)

Logs

N/A

[mergify]

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @pkoutsovasilis? 🙏.
For such, you'll need to label your PR with:

• The upcoming major version of the Elastic Stack
• The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-v8./d.0 is the label to automatically backport to the 8./d branch. /d is the digit

[elasticmachine]

Pinging @elastic/sec-deployment-and-devices (Team:Security-Deployment and Devices)

[elasticmachine]

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b pkoutsovasilis/netflow_disable_normalisation upstream/pkoutsovasilis/netflow_disable_normalisation
git merge upstream/main
git push upstream pkoutsovasilis/netflow_disable_normalisation

[andrewkroh]

LGTM