Migrate MirrorVulnerabilityProcessor
from Kafka Streams to Parallel Consumer
#553
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Migrates
MirrorVulnerabilityProcessor
from Kafka Streams to Parallel Consumer.Warning
Depends on #552, please review and merge that first!Addressed Issue
Relates to DependencyTrack/hyades#346
Relates to DependencyTrack/hyades#901
Relates to DependencyTrack/hyades#907
Additional Details
The processor defaults to ordering mode
partition
with a max concurrency matching the number of input partitions.Ordering mode
partition
enables head-of-line blocking semantics, meaning the processor will continue retrying failing records instead of dropping them and proceeding to consume more.This behavior is desirable because the
dtrack.vulnerability
topic is compacted, and records are never re-published unless the respective vulnerability has changed.Checklist
This PR fixes a defect, and I have provided tests to verify that the fix is effectiveThis PR introduces changes to the database model, and I have added corresponding update logicThis PR introduces new or alters existing behavior, and I have updated the documentation accordingly