[Thanos] Consistent Hashing in Thanos Receive Hashrings #613
Locked
nate-double-u
started this conversation in
Google Summer of Code 2022
Replies: 1 comment
-
Hi Thanos people, In short my CV is:
Check the full CV in LinkedIn: https://www.linkedin.com/in/razvan-vacaru-17787b5a/ My goal is to increase my knowledge of the K8s ecosystem, monitoring and Golang. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The current implementation of the Thanos Receive uses non-consistent hashing to distribute metrics across distributed ingesting replicas. The scalability that this enables can be improved. Because the hash is not consistent, every change in number or replicas considered for metric distribution can cause larger memory utilization for short periods. In the past, we tried to mitigate this problem by flushing the replica content to object storage which caused delays in scale-out and down. Switching to consistent hash implementation like a hash ring would allow us to mitigate this issue without delaying the scaling process. This should improve the life of Thanos receive users by enabling easier auto-scaling capabilities for production systems that have to react to different metric consumption characteristics. Join us in the effort of moving the hashing method to a consistent one!
Mentor(s): Lucas Servén Marín (@squat), Prem Saraswat (@onprem), Matej Gera (@matej-g)
https://github.com/cncf/mentoring/blob/main/summerofcode/2022.md#consistent-hashing-in-thanos-receive-hashrings
Beta Was this translation helpful? Give feedback.
All reactions