Backpressure
Subject: Computer and Technology noun /ˈbækˌprɛʃ.ər/ 1 definition
- distributed-systems
- stream-processing
- flow-control
- computer-networking
-
Definition (noun)
Entry #248 · UpdatedBackpressure is a flow-control mechanism in data pipelines, streaming architectures, and networked systems that slows or pauses upstream producers when downstream consumers become saturated. By propagating congestion feedback backward through a processing chain—either implicitly through bounded buffers and blocked I/O or explicitly via demand signals—it aligns transmission rates with actual processing capacity. Its core purpose is to maintain system stability, bound memory consumption, and prevent cascading overload across interconnected components.
Common Forms
Blocking and Bounded Queues: Fixed-capacity buffers stall upstream write calls or suspend producer threads once full, forcing ingestion rates to match consumer throughput.
Credit-Based and Pull Signaling: Consumers explicitly grant capacity tokens or window updates—such as TCP receive windows, HTTP/2 flow-control frames, or Reactive Streams demand signals—limiting producers to pre-authorized volume.
Protocol Congestion Feedback: Saturated services return explicit throttling responses, such as HTTP
429 Too Many Requestsor503 Service Unavailablewith retry delays, instructing upstream callers to back off.Bounded Overflow Policies: When live producers cannot be paused, such as telemetry streams or sensor feeds, pipelines drop stale items, conflate intermediate updates, or shed excess load to stay stable.
Example
During a bulk log-ingestion job, an analytics database indexes 20,000 events per second while an upstream collector reads from disk at 80,000 events per second. As the database's TCP receive buffer fills, it advertises a zero receive window, causing the collector's outbound socket buffer to fill so its write calls block and disk reads pause until consumer capacity recovers.