Coinbase had 8 degraded-performance incidents in the past month including a 6.5-hour outage on May 7–8 that put markets into cancel-only mode.
The last one gets the headlines because AWS overheated a data center in Virginia.
Easy story, external villain.
One outage is bad luck. But eight in thirty days is a pattern — and patterns are architectural, not accidental.
What eight incidents in a month actually means: somewhere in the system, the resilience work nobody wanted to prioritize is overdue. The runbook that never got written. The cross-zone dependency nobody mapped. The failover path that was “tested in staging” two years ago and never since. That work is invisible right up until the month it isn’t.
Three days before the big one, the CEO announced 14% layoffs and pitched an AI-native future where one person ships what teams used to. Cause and effect? No — these architectural choices predate the layoffs by years. But it’s a signal about what the org values going forward. And the failure mode on display is exactly the kind that gets worse, not better, when speed beats judgment.
I wrote earlier this week about the prototype gap (https://lnkd.in/edqVH5Te) — the difference between AI-assisted shipping and production survivability. AI is genuinely good at knowledge: syntax, patterns, working prototypes in two days. AI cannot give you the instinct to ask “what happens when an aws zone goes down and our control plane lives there?” That instinct comes from someone who got paged at 2am, three years ago, for the same class of bug.
Maybe it’s bad luck. And honestly, it could happen to us someday — I won’t pretend we’re immune.
That gap — between companies that treat “MVP” and “production-ready” as interchangeable — is going to keep growing. And as AI makes it easier than ever to ship fast, the discipline to ask “but what breaks at 2x load, with one AZ down, on a Friday?” becomes a competitive moat, not a footnote.
My job, and the job of our engineering team, is to make sure we don’t get “unlucky” when building systems.
don't even get me started on the wells fargo app