Improve Kafka clowder configuration injection

[joselsegura]

Description

The Clowder configuration is able to inject new Kafka broker configuration parameters. This change intends to unify the way that it is handled (making it non dependent on the Kafka library used by the components).

It also adapts the current Kafka-related components in order to use the new approach.

This is very helpful to perform the needed changes for Confluent Kafka migration

Type of change

• Refactor (refactoring code, removing useless files)

Testing steps

Just locally, going to test in ephemeral (I need a PR for that)

Checklist

• make before_commit passes
• updated documentation wherever necessary
• added or modified tests if necessary
• updated schemas and validators in insights-data-schemas in case of input/output change

[codecov-commenter]

Codecov Report

Patch coverage: 70.58% and project coverage change: +0.51 🎉

Comparison is base (968cf71) 83.61% compared to head (0e9eb88) 84.13%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #50      +/-   ##
==========================================
+ Coverage   83.61%   84.13%   +0.51%     
==========================================
  Files          21       21              
  Lines         702      731      +29     
==========================================
+ Hits          587      615      +28     
- Misses        115      116       +1     

Impacted Files	Coverage Δ
ccx_messaging/utils/clowder.py	0.00% <0.00%> (ø)
ccx_messaging/consumers/kafka_consumer.py	82.64% <70.00%> (-0.98%)	⬇️
...cx_messaging/publishers/data_pipeline_publisher.py	94.11% <90.00%> (-1.34%)	⬇️
ccx_messaging/consumers/consumer.py	88.43% <100.00%> (+1.30%)	⬆️
ccx_messaging/publishers/sha_publisher.py	97.91% <100.00%> (+0.24%)	⬆️
ccx_messaging/utils/kafka_config.py	100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[tisnik]

all right!!

[epapbak]

ok