Skip to content

server: configurable gRPC max concurrent streams - #1272

Merged
psbrar99 merged 3 commits into
envoyproxy:mainfrom
nacx:pr/c-grpc-max-streams
Oct 21, 2026
Merged

psbrar99 merged 3 commits into
envoyproxy:mainfrom
nacx:pr/c-grpc-max-streams

Conversation

@nacx

@nacx nacx commented Oct 13, 2026

Copy link
Copy Markdown
Member

While Redis is unresponsive, every rate limit call is blocked inside the service, and with no limit on concurrent streams, the blocked calls, and the goroutines and memory serving them, keep piling up for as long as Redis stays away.

This PR adds GRPC_MAX_CONCURRENT_STREAMS (defaults to 0, the gRPC default) to bound the concurrent calls per gRPC connection, so excess calls wait on the client side instead.

nacx and others added 2 commits October 13, 2026 11:33
While Redis was unresponsive, every rate limit call blocked inside the
service, and with no limit on concurrent streams the blocked calls,
and the goroutines and memory serving them, kept piling up for as long
as Redis stayed away.

Add GRPC_MAX_CONCURRENT_STREAMS (default 0, the gRPC default) to bound
the concurrent calls per gRPC connection, so excess calls wait on the
client side instead.

Signed-off-by: Ignasi Barrera <ignasi@tetrate.io>
Clarified timeout settings for Redis connection establishment.

Signed-off-by: Prabhjot Singh <86856448+psbrar99@users.noreply.github.com>
@psbrar99

Copy link
Copy Markdown
Contributor

Overlaps with #1241, which also adds GRPC_MAX_CONCURRENT_STREAMS

psbrar99
psbrar99 previously approved these changes Oct 15, 2026
Signed-off-by: Ignasi Barrera <ignasi@tetrate.io>
@psbrar99
psbrar99 merged commit 480c102 into envoyproxy:main Oct 21, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants