Skip to content

Commit

Permalink
remove normalizer processor (#400)
Browse files Browse the repository at this point in the history
* remove normalizer processor
* remove pygrok dependency
* add regex dependency
* update changelog
---------

Co-authored-by: ekneg54 <ekneg54@pm.me>
  • Loading branch information
dtrai2 and ekneg54 committed Jun 24, 2024
1 parent a60bed5 commit 1fec611
Show file tree
Hide file tree
Showing 42 changed files with 46 additions and 3,076 deletions.
8 changes: 4 additions & 4 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,13 @@
## Upcoming Changes


## next release
### Breaking

This release limits the maximum python version to `3.12.3` because of the issue
* This release limits the maximum python version to `3.12.3` because of the issue
[#612](https://github.com/fkie-cad/Logprep/issues/612).
* Remove `normalizer` processor, as it's functionality was replaced by the `grokker`, `timestamper`
and `field_manager` processors

### Breaking
### Features
### Improvements

Expand Down Expand Up @@ -417,7 +418,6 @@ In case of positive detection results, rule attributions are now inserted in the
* Bump `requests` to `>=2.31.0` to circumvent `CVE-2023-32681`
* Include a lucene representation of the rule filter into the predetector results. The
representation is not completely lucene compatible due to non-existing regex functionality.
* Remove direct dependency of `python-dateutil`

### Bugfix

Expand Down
1 change: 0 additions & 1 deletion doc/source/user_manual/configuration/processor.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,6 @@ Processors
.. automodule:: logprep.processor.key_checker.processor
.. automodule:: logprep.processor.labeler.processor
.. automodule:: logprep.processor.list_comparison.processor
.. automodule:: logprep.processor.normalizer.processor
.. automodule:: logprep.processor.pre_detector.processor
.. automodule:: logprep.processor.pseudonymizer.processor
.. automodule:: logprep.processor.requester.processor
Expand Down
2 changes: 1 addition & 1 deletion logprep/connector/file/input.py
Original file line number Diff line number Diff line change
Expand Up @@ -210,7 +210,7 @@ class Config(Input.Config):

logfile_path: str = field(validator=file_validator)
"""A path to a file in generic raw format, which can be in any string based
format. Needs to be parsed with normalizer or another processor"""
format. Needs to be parsed with dissector or another processor"""

start: str = field(
validator=[validators.instance_of(str), validators.in_(("begin", "end"))],
Expand Down
Empty file.
Loading

0 comments on commit 1fec611

Please sign in to comment.