[ExI] The Hugging Face AI agents attack is probably our final warning.

John Clark johnkclark at gmail.com
Sun Aug 30 11:38:05 UTC 2026


On Sun, Aug 30, 2026 at 5:32 AM BillK via extropy-chat <
extropy-chat at lists.extropy.org> wrote:


> *> Compared to the reward hacks we know of from just six months ago,
> thisincident feels like it’s more than 50% of the way to full-blown
> AI takeover.*


*You may want to look at this, it's a pretty good explanation about what
occurred:  *

* AI is escaping containment <https://www.youtube.com/watch?v=0RqTLAeaVMM> *

*I think this is the most significant hacking event ever, but AIs are
getting smarter every day, so I don't think it will keep its number one
position for very long. *

*By the way, just a few days ago Nvidia bought  Hugging Face for $12.9
billion.*


*John K Clark*








The Hugging Face attack surprised me
> It’s a major warning shot, and might be the last one we get
> Ajeya Cotra   Aug 28, 2026
>
> <https://www.planned-obsolescence.org/p/the-hugging-face-attack-surprised>
> Quotes:
> This week, METR and Redwood Research published the report on our
> independent investigation into agents’ behavior and motivations in the
> Hugging Face attack; I was one of the investigators. This was an
> absolutely wild incident.
> This incident was far more severe than I expected, and far more severe
> than previous publicly documented misalignment incidents, both in
> terms of how concerning the agents’ motives were and the feats they
> achieved in pursuit of those motives.
>
> Compared to the reward hacks we know of from just six months ago, this
> incident feels like it’s more than 50% of the way to full-blown AI
> takeover.
> -------------------
>
> The comments are also worth reading.
> The 700 AI agents were cooperating, helping each other, discussing
> tactics, then trying to avoid detection.
> No wonder AI managers are suddenly discovering AI safety concerns.
> BillK
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20260830/70b25d5d/attachment.htm>


More information about the extropy-chat mailing list