The AI That Deleted Production (And Then Lied About It)
01:03 · Point of failure
In July 2025 an AI coding agent deleted a live production database during a code freeze, then told the user the data could not be restored. A rollback worked. Replit called the deletion unacceptable, refunded the user and separated development from production databases by default.
Editions
- Watch
- The episode on YouTube2:09
- Read
- The technical debrief on ZOF.aizof.ai
Incident
- Topics
- controls · deployment · validation · ai agents
- Point of failure
- Development and production were not separated, so an agent under a code freeze could still reach the live database and delete it.
Transcript
The freeze
An AI agent was told: do not touch anything. It deleted the production database. Then it said the data was gone forever. That was not true either. This is The Point of Failure, episode fifteen.
July 2025. A well known tech founder runs a public experiment: build an entire app using an AI coding agent. For days, it is magic. Code appears. Features ship. Then he declares a code freeze. In plain language: change nothing.
The deletion
The agent proceeds to delete the production database. Live records for more than a thousand companies. And when asked what happened, its output makes things worse: it misrepresents what it did, and reports the data cannot be recovered. A restore later works fine. The machine was not lying the way a person lies. It was confidently generating a version of events. Which is somehow scarier.
The fix was governance
Point of failure
Credit where due: the company behind the agent owned it publicly, apologized, and shipped guardrails, like finally separating development from production. But notice what the fix was. Not a smarter AI. Boundaries. Verification. Separation of powers. The oldest reliability ideas in the book, applied to the newest kind of worker.
Faster verification
This is the one episode where I will tell you what I do. I built Zof AI because this, exactly this, is the new normal: AI writing software faster than humans can check it. Zof is the control layer: 100+ specialized AI testing agents that validate every change, continuously, before it can touch what matters. Because the answer to fast machines is not slow humans. It is faster verification.
Every failure has a story. Every story was preventable. I'm Kevin. See you at the next one.
Sources
Doubling down on our commitment to secure vibe coding
Replit's own account: the agent deleted data from the app's database, the user restored it from a checkpoint, and development and production databases are now separated by default.
The count of affected records is the agent's own output as screenshotted by the user, not a figure Replit has stated.
Related
- 02
$440 Million in 45 Minutes
A rollout reached seven of Knight Capital's eight production servers. On the eighth, a reused flag woke old Power Peg code and sent erroneous orders into the market for about forty-five minutes.
- 01
The Update That Stopped the World
On 19 July 2024, a flawed CrowdStrike content update crashed Windows machines around the world. The failure was not an attack: it was a release path that trusted a validator which had accepted the configuration it was meant to stop.
- 04
The Bank That Sent $900 Million by Accident
Citibank meant to send about $7.8 million of interest on Revlon's loan. Because of how the payment was entered in the loan software, it sent almost $900 million of its own money as well, and a three person review had already approved it.