Skip to content

Say why a lagging request is disconnected - #1003

Merged
sduchesneau merged 2 commits into
developfrom
fix/lag-disconnect-errors
Oct 16, 2026
Merged

sduchesneau merged 2 commits into
developfrom
fix/lag-disconnect-errors

Conversation

@sduchesneau

@sduchesneau sduchesneau commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

A production request that falls more than 2 segments behind the last final block is disconnected so the client reconnects and back-processes the gap in parallel. Both places that do this returned the server shutdown error, endpoint is shutting down, please reconnect. Each now has its own error, still Unavailable:

  • pipeline.ErrBackprocessEndedTooFarBehind when back-processing finishes too far behind (service/tier1.go)
  • pipeline.ErrStreamFellTooFarBehind when streamed final blocks fall behind (checkFinalBlockLag)

service/error.go maps both to Unavailable for connect and gRPC clients, and a new test checks the code and message on both paths.

Requests that fall too far behind the last final block got the server
shutdown error. Give each of the two cases its own error.
@dfuse-bot

dfuse-bot commented Oct 16, 2026 •

Copy link
Copy Markdown

🔍 Vulnerabilities of ghcr.io/streamingfast/substreams:5ac3cf3

📦 Image Reference ghcr.io/streamingfast/substreams:5ac3cf3
digestsha256:7ba30e1e0c4e2ae4c0c5d02345db8ebb69ee0a956515a58955e9da15460100b0
vulnerabilitiescritical: 0 high: 0 medium: 0 low: 0
platformlinux/amd64
size127 MB
packages382
📦 Base Image ubuntu:24.04
also known as
  • noble
  • noble-20260917
digestsha256:f610ab94648195aa356059f5b41d6085c9d4d903c072430cdd1af7bdb646106b
vulnerabilitiescritical: 0 high: 1 medium: 20 low: 7

Base automatically changed from fix/transient-wasm-errors to develop October 16, 2026 15:32
@sduchesneau
sduchesneau marked this pull request as ready for review October 16, 2026 15:34

@UlysseCorbeil UlysseCorbeil left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@sduchesneau
sduchesneau merged commit d18ca66 into develop Oct 16, 2026
9 checks passed
@sduchesneau
sduchesneau deleted the fix/lag-disconnect-errors branch October 16, 2026 15:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants