A fault-tolerant API gateway routing millions of events a day.
STACK
A fault-tolerant gateway that routes millions of events a day across microservices, with circuit breaking, retries, and transparent failover — deployed on Kubernetes.
A growing microservices architecture had no consistent routing or failure-handling layer — each service implemented its own retry logic inconsistently, and a single slow downstream service could cascade into a platform-wide outage with no circuit breaker to stop it.
Built a dedicated gateway handling routing, circuit breaking, and retries in one place, so individual services no longer need to reimplement resilience logic — and a failing downstream service degrades gracefully instead of cascading.
Each downstream service gets its own circuit breaker state, so one failing service can’t take down routing to healthy ones.
Multi-region service instances are tried in priority order automatically, invisible to the calling service.
Built the gRPC routing layer with per-service circuit breakers.
Added transparent multi-region failover and rolled out gradually behind a feature flag per service.
Centralizing resilience logic in the gateway, rather than trusting every service team to implement it consistently, was the single highest-leverage decision on this project.
If this project resonates with what you're building, let's talk. I take on a limited number of projects each quarter.
hello@martinsai.name.ng · Response within 24h