Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Limit number of inflight HTTP requests #14116

Closed
incident-io bot opened this issue Oct 12, 2023 · 2 comments · Fixed by #15977
Closed

Limit number of inflight HTTP requests #14116

incident-io bot opened this issue Oct 12, 2023 · 2 comments · Fixed by #15977
Assignees
@michael-redpanda
Labels
area/pandaproxy REST interface for Kafka API area/schema-registry Schema Registry service within Redpanda remediation Incident follow-ups that also show up in Incident.io when this label is used.

Comments

@incident-io
Copy link

incident-io bot commented Oct 12, 2023

If unbounded, a large number of HTTP requests may exhaust the SSG cross-shard semaphores. The SSG semaphores are doing their job, but the "failure" (not a failure, just a lot of HTTP connections hanging) is subtle. Make it more explicit by limiting the total number of HTTP requests in flight and any additional ones are rejected with a 4xx or 5xx status code.

This action was created from Incident 373 by Mike Boquard, using incident.io 🔥
@incident-io incident-io bot added area/pandaproxy REST interface for Kafka API area/schema-registry Schema Registry service within Redpanda labels Oct 12, 2023
@michael-redpanda michael-redpanda added the remediation Incident follow-ups that also show up in Incident.io when this label is used. label Oct 12, 2023
@DarranCooke
Copy link

Do we have an ETA on this? We spoke to the customer yesterday who is looking for timelines?

@mattschumpert
Copy link

Its a stretch goal for 23.3

@michael-redpanda michael-redpanda mentioned this issue Jan 5, 2024
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@michael-redpanda michael-redpanda

Labels
area/pandaproxy REST interface for Kafka API area/schema-registry Schema Registry service within Redpanda remediation Incident follow-ups that also show up in Incident.io when this label is used.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Reject PP/SR HTTP requests if cross shard semaphore has been exhausted michael-redpanda/redpanda
3 participants
@DarranCooke @mattschumpert @michael-redpanda