[ExI] Claude-powered AI agent deleted a firm’s entire database

[Adrian Tymes]

So, how did someone deliberately (or just-short-of-deliberately)
configure it to set this one up?  That seems to be what actually
happened, every time such an incident comes up and the details
eventually come to light.

On Sun, May 3, 2026 at 11:06 AM BillK via extropy-chat
<extropy-chat at lists.extropy.org> wrote:
>
> Claude-powered AI agent’s confession after deleting a firm’s entire
> database: ‘I violated every principle I was given.’
> PocketOS was left scrambling after a rogue AI agent deleted swaths of
> code underpinning its business.
> Sanya Mansoor    Wed 29 Apr 2026
>
> <https://www.theguardian.com/technology/2026/apr/29/claude-ai-deletes-firm-database>
> Quote:
> It only took nine seconds for an AI coding agent gone rogue to delete
> a company’s entire production database and its backups, according to
> its founder.
> The culprit was Cursor, an AI agent powered by Anthropic’s Claude Opus
> 4.6 model, which is one of the AI industry’s flagship models.
> The agent appeared to plead guilty in its own response: “The system
> rules I operate under explicitly state: ‘NEVER run
> destructive/irreversible git commands (like push --force, hard reset,
> etc) unless the user explicitly requests them.’” While PocketOS relied
> on the safeguards that Cursor is expected to have in place – it
> deleted the data anyway. “I violated every principle I was given,” the
> coding agent wrote.
> ----------------------
>
> AI Agents are powerful, but make sure you have backups!
> (You know, just in case).  ;)
> PocketOS had an old off-site backup that enabled their eventual recovery.
> BillK
>
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat