Skip to content

Commit

Permalink
remove elasticsearch_output connector (#620)
Browse files Browse the repository at this point in the history
* Update changelog
* remove elasticsearch dependency
* remove elasticsearch output
* remove get_conn mock and use responses with ordered registry
  • Loading branch information
ekneg54 authored Jun 27, 2024
1 parent 2de1a59 commit e066f2d
Show file tree
Hide file tree
Showing 19 changed files with 429 additions and 925 deletions.
2 changes: 2 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,8 @@
* This release limits the maximum python version to `3.12.3` because of the issue
[#612](https://github.com/fkie-cad/Logprep/issues/612).
* Remove `normalizer` processor, as it's functionality was replaced by the `grokker`, `timestamper` and `field_manager` processors
* Remove `elasticsearch_output` connector to reduce maintenance effort


### Features

Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@

Logprep allows to collect, process and forward log messages from various data sources.
Log messages are being read and written by so-called connectors.
Currently, connectors for Kafka, Opensearch, ElasticSearch, S3, HTTP and JSON(L) files exist.
Currently, connectors for Kafka, Opensearch, S3, HTTP and JSON(L) files exist.

The log messages are processed in serial by a pipeline of processors,
where each processor modifies an event that is being passed through.
Expand Down
2 changes: 1 addition & 1 deletion doc/source/development/architecture/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ The Ruletree diagramm shows how the matching rules for a given event are searche
Output
======

In this diagram, the last part about the backlog is specific for the Elasticsearch/ Opensearch Output.
In this diagram, the last part about the backlog is specific for the Opensearch Output.
This was deemed to be important enough to be part of the diagram.

.. raw:: html
Expand Down
9 changes: 1 addition & 8 deletions doc/source/user_manual/configuration/output.rst
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ logprep only guaranties that one output has received data by calling the
.. security-best-practice::
:title: Output Connectors
:location: config.output.<Output-Name>.type
:suggested-value: <ConfluentKafkaOutput|ElasticsearchOutput|OpensearchOutput|S3Output>
:suggested-value: <ConfluentKafkaOutput|OpensearchOutput|S3Output>

Similar to the input connectors there is a list of available output connectors of which some
are only meant for debugging, namely: :code:`ConsoleOutput` and :code:`JsonlOutput`.
Expand Down Expand Up @@ -43,13 +43,6 @@ logprep only guaranties that one output has received data by calling the
:inherited-members:
:noindex:

.. automodule:: logprep.connector.elasticsearch.output
.. autoclass:: logprep.connector.elasticsearch.output.ElasticsearchOutput.Config
:members:
:undoc-members:
:inherited-members:
:noindex:

.. automodule:: logprep.connector.opensearch.output
.. autoclass:: logprep.connector.opensearch.output.OpensearchOutput.Config
:members:
Expand Down
Empty file.
Loading

0 comments on commit e066f2d

Please sign in to comment.