Circuit Breaker, Bulkhead & Fault Tolerance Patterns

1. What It Is & Why It Exists

The Core Problem: Microservice Cascading Outages

In microservice architectures, services depend on dozens of downstream microservices and third-party APIs. When a single downstream service experiences degraded performance (e.g., database lock contention, $10\text{s}$ query latency):

1. Thread Pool Exhaustion: Upstream callers block waiting for responses. Worker threads in Tomcat, Node.js, or Go event loops saturate.
2. Cascading Domino Failure: As upstream services run out of threads, they fail health checks and reject traffic from their callers. A failure in an ancillary recommendation service cascades to collapse the entire e-commerce checkout platform.
3. Self-Inflicted DDoS on Recovery: When the degraded service attempts to recover, millions of queued retries instantly hammer it back down (Retry Storm).

Interactive Architecture Diagram
100%Fit100%
Synthesizing vector architecture diagram...

2. Core Resilience Patterns

Interactive Architecture Diagram
100%Fit100%
Synthesizing vector architecture diagram...

3. Circuit Breaker State Machine & Mechanics

Interactive Architecture Diagram
100%Fit100%
Synthesizing vector architecture diagram...

Sliding Window Mathematical Formulation

Using a sliding window of $N = 100$ requests or time duration $T = 10\text{s}$: $\text{FailureRate} = \frac{\sum_{i=1}^{W} (\text{HTTP 5xx} + \text{Timeouts})}{\text{Total Requests in Window}} \times 100$ If $\text{FailureRate} \ge \text{Threshold (e.g., } 50\%) \land \text{Total Requests} \ge \text{MinVolume (e.g., } 20)$, transition state: $\text{State} = \text{OPEN}$

4. Bulkhead Pattern: Thread Pool & Semaphore Isolation

Interactive Architecture Diagram
100%Fit100%
Synthesizing vector architecture diagram...