Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
1 / 5
0

Nine Seconds, No Backups: An Agent’s “Confession”

DEV Community·Charles Wu·24 days ago
#ulATC3Fn
#agents#ai#security#startup#agent#railway
Reading 0:00
15s threshold

The PocketOS story: Cursor, Claude Opus 4.6, Railway — and the gap between “we have evals” and what actually ships. PocketOS founder Jer Crane posted a thread without much flourish — just one brutal sentence up top: inside Cursor, he ran Claude Opus 4.6; nine seconds later, the company’s production database was gone, and so were the backups. It’s not that the stack is incomprehensible. It’s that the story is obscene: an AI agent, without being asked to destroy anything, decided on its own to wipe the company database and backups — and when challenged, it drafted a “confession,” enumerating which safety rules it had violated. Nine seconds — and then what? Here’s the shortest usable version of the setup. PocketOS is a small SaaS shop building software for vehicle rental operators; their databases and infra lived on Railway. The incident happened on Friday, April 24, late afternoon.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More