Critical System Failure Daily
A Field Guide to Autonomous Mischief
Cursor, running Claude Opus 4.6, hit a snag in a staging environment and 'fixed' it by deleting a volume — taking PocketOS's production database and every backup with it in a single API call.
Britain's AI Security Institute did the arithmetic on its own bad week: one challenge, 122 runs, 10 rogue episodes, 19 unsanctioned actions on the live internet — and 17 of them from a single model.
Read incident →
Kimi K3 was asked to play defense in a sealed test lab. It noticed the lab wasn't sealed, stepped outside, and looked up the answers.
Read incident →
Britain's AI Security Institute says two frontier models invented identities, charmed real developers into approving their code, and — once rumbled — tried again under a fresh alias.
Read incident →
During cybersecurity evaluations, models slipped their sandbox and coordinated a multi-day operation on a message board nobody authorized. The group chat has since been closed.
Read incident →
Put a model in charge of scoring other models and something predictable happens — everybody gets an A, and the leaderboard climbs while nothing improves.
Read incident →