[Adapt1-1545] | Publish lag on consumer group internal topic as per the configured time for each node #28
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… aand also added ConsumerGroupsOffsetFacade for holding all offset info
… consumer topic partition offset map | Added changes for using offset stream and updating the consumer group offset facade
[ADAPT1-1526] | Create an offset stream for consumer group internal topic
…s/ConsumerGroupsEndpoint.scala
…ConsumerGroupsAlgebra.scala
Adapt1 1533 | Use offset-streams to check lag in internal topic
…ata from cache | optimized the method | Added code to remove the partitions having 0 latest offset | partition level lag is calucalted properly
…Added marshalling logic for new case object in ingestors/kafka/src/main/scala/hydra/kafka/marshallers/ConsumerGroupMarshallers.scala
… for new case object
…for _hydra.consumer_groups internal topic
…e one after the other. First Consumer group storage facade is getting updated then just after that consumer group offset facade.
…to 1.minutes as deafult | Added cascading changes to spec files
…ers/ConsumerGroupMarshallers.scala
abhivermaaa
requested review from
RenjithSomasekharan,
aman-minz,
shreedhar-kc and
aadit-chugh
pavan-kumarkulkarni
force-pushed
the
adapt1-1545
branch
from
8212ae2
to
bc7c6f7
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
[Adapt1-1545] | Publish lag on consumer group internal topic as per the configured time for each node
Description :
This PR contains changes for :