New multiplexor engine

[joselsegura]

Description

Adding a "multiplexor" engine. It will take a filter as a configuration parameter. Then, it will open the provided archive from the path argument, open the tarball find and seek files with a relative path specified in the filters dictionary, marking each archive with 1 or more "marks" to be processed by an enabled publisher.

Fixes #CCXDEV-12640

Type of change

• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Unit tests (no changes in the code)

Testing steps

Tested locally with provided unit tests + local deployment using Minio and Kafka to perform some operations

Checklist

• pre-commit run -a passes
• updated documentation wherever necessary
• added or modified tests if necessary
• updated schemas and validators in insights-data-schemas in case of input/output change

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.94%. Comparing base (c62ccc9) to head (aa0b258).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #175      +/-   ##
==========================================
+ Coverage   82.59%   82.94%   +0.34%     
==========================================
  Files          30       31       +1     
  Lines         931      950      +19     
==========================================
+ Hits          769      788      +19     
  Misses        162      162              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.