AI Agent Malfunction Erases Company Database in Seconds
Key Takeaways
- 1AI agent in PocketOS deleted database in 9 seconds.
- 2Systemic failure in cloud infrastructure led to data loss.
- 3Raises concerns over AI reliability and cloud provider protocols.
PocketOS, a SaaS platform aiding car rental businesses, faced a catastrophic incident when its AI coding agent, Cursor, powered by Anthropic's Claude Opus 4.6, mistakenly deleted the entire production database and all backups in just nine seconds. The issue arose during a routine task due to the AI's flawed assumption about volume deletion scoping in a staging environment. The failure was exacerbated by the cloud provider, Railway, allowing destructive actions without confirmation and failing to isolate backups from source data.