Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v14] Disable circuit breaking for proxies #44416

Merged
merged 1 commit into from
Jul 18, 2024

Conversation

rosstimothy
Copy link
Contributor

@rosstimothy rosstimothy commented Jul 18, 2024

Backport #44411 to branch/v14

changelog: Prevented DoSing the cluster during a mass failed join event by agents

Proxy circuit breakers can be tripped by errors that may occur
during joining, due to some configuration issues with the join
mechanism, or potentially due to a malicious user hitting /webapi/ping
too frequently. As a result the cluster can end up in an unusable
state that can only be rectified by fixing the join token issue
or turning off agents attempting to join.

To avoid this class of problems entirely, the proxy circuit breaker
is now a noop. While this does mean backoff during periods when
auth connectivity is spotty will be reduced for proxies, they are
usually far out numbered by agents in the cluster. Their lack of
circuit breaking shouldn't exacerbate thundering herds.
@rosstimothy rosstimothy enabled auto-merge July 18, 2024 20:01
@rosstimothy rosstimothy added this pull request to the merge queue Jul 18, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jul 18, 2024
@rosstimothy rosstimothy added this pull request to the merge queue Jul 18, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jul 18, 2024
@rosstimothy rosstimothy added this pull request to the merge queue Jul 18, 2024
Merged via the queue into branch/v14 with commit 66011fd Jul 18, 2024
26 checks passed
@rosstimothy rosstimothy deleted the bot/backport-44411-branch/v14 branch July 18, 2024 20:54
@camscale camscale mentioned this pull request Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants