Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove redundant wildcard after %{SPACE} patterns #15900

Merged

Conversation

ycombinator
Copy link
Contributor

@ycombinator ycombinator commented Jan 28, 2020

What does this PR do?

It improves the grok patterns used in the elasticsearch Filebeat module's ingest pipelines. Specifically, it removes any ? or * wildcards after the %{SPACE} pattern, since that pattern already incorporates the * wildcard.

Why is it important?

Without this change, when the module's ingest pipelines are setup in Elasticsearch, the Elasticsearch server logs get flooded with warnings like so:

regular expression has redundant nested repeat operator * /... long regex is shown here .../

Checklist

  • My code follows the style guidelines of this project
  • [ ] I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files
  • [ ] I have added tests that prove my fix is effective or that my feature works There are existing golang integration tests.

Related issues

@elasticmachine
Copy link
Collaborator

Pinging @elastic/stack-monitoring (Stack monitoring)

@ycombinator ycombinator force-pushed the fb-es-fix-grok-redundant-wildcards branch from e8772ca to 8e42ac3 Compare January 30, 2020 20:37
@ycombinator ycombinator removed v6.8.7 needs_backport PR is waiting to be backported to other branches. labels Jan 31, 2020
ycombinator added a commit that referenced this pull request Feb 5, 2020
)

* Remove redundant wildcard after %{SPACE} patterns (#15900)

* Remove redundant wildcard after %{SPACE} patterns

* Adding CHANGELOG entry

* Cleaning up CHANGELOG
ycombinator added a commit that referenced this pull request Feb 5, 2020
)

* Remove redundant wildcard after %{SPACE} patterns (#15900)

* Remove redundant wildcard after %{SPACE} patterns

* Adding CHANGELOG entry

* Cleaning up CHANGELOG
@ycombinator ycombinator added v7.6.0 and removed v7.6.1 labels Feb 5, 2020
ycombinator added a commit that referenced this pull request Feb 6, 2020
)

* Remove redundant wildcard after %{SPACE} patterns (#15900)

* Remove redundant wildcard after %{SPACE} patterns

* Adding CHANGELOG entry

* Cleaning up CHANGELOG
@andresrc andresrc added the Team:Integrations Label for the Integrations team label Mar 6, 2020
@cawoodm
Copy link
Contributor

cawoodm commented Mar 13, 2020

We've upgraded ElasticSearch AND all our FileBeats from 7.3 to 7.6 today and are suddenly having this issue. Is there any way to tell which filebeat is causing the issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Filebeat Elasticsearch module pipeline causing regex error on Elasticsearch cluster node
5 participants