-
Notifications
You must be signed in to change notification settings - Fork 206
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] message field not been parsed with Grok #5247
Comments
I changed the lines bellow:
This is working:
|
github-project-automation
bot
moved this from Unplanned
to Done
in Data Prepper Tracking Board
Dec 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
I am ingesting pfSense firewall log (syslog RFC 3164) with Fluetbit:
Here is how Fluentbit parses the log before sending to data-prepper:
https://raw.githubusercontent.com/fluent/fluent-bit/refs/heads/master/conf/parsers.conf
Here is the data-repper pipeline:
Here is the grok patter:
Originaly taken from https://gist.githubusercontent.com/Caligatio/878002ab4aa591747a3dcdbd1101db41/raw/4c0d33b75a6f064dc4b4ae3359fa24d77f2a7fa3/pfsense2-3.grok
I have to made some adjustments because the original was giving me some errors when starting data-prepper.
Here is what I get on opensearch:
The field message is not been parsed.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
I expected the message part of the log been splinted by fields as specified on the grok pattern.
Screenshots
If applicable, add screenshots to help explain your problem.
Environment (please complete the following information):
NAME="Rocky Linux"
VERSION="9.4 (Blue Onyx)"
openserach, dashboard, fluentbit originaly taken from:
https://github.com/opensearch-project/data-prepper/blob/main/examples/log-ingestion/README.md
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: