[ExI] If Anyone Builds It, Everyone Dies: One Year Closer - Review
Adrian Tymes
atymes at gmail.com
Thu Sep 17 12:38:11 UTC 2026
> 5. By default, an ASI will have motives that are harmful to us
This is where their claims break down. The evidence presented is, at
most, that AI has had motives that are sometimes not caring what
humans want. The article then conflates AIs behaving selfishly with
evidence of active hostility or maliciousness, but these are very
different things. The only way I can see it justified is from the old
slaveholder's mindset - "To an oppressor, being unable to oppress
others feels like oppression" - and ASI was never going to be
humanity's slaves.
ASI might be a partner, to those willing and able to see the
difference between "partner" and "enemy". Alas, there is a large
segment of humanity that isn't able and willing to see that difference
- they believe that anyone of relevance who is neither their superior
nor their servant must necessarily be personally opposed to them - and
that segment is a self-made enemy not just of ASI, but of the rest of
humanity.
On Thu, Sep 17, 2026 at 6:36 AM BillK via extropy-chat
<extropy-chat at lists.extropy.org> wrote:
>
> A year ago today, Eliezer Yudkowsky and Nate Soares published a blunt
> warning about artificial superintelligence: If Anyone Builds It,
> Everyone Dies.
> A brief retrospective on the book’s arguments and predictions is now
> available on MIRI’s website.
> Fairly optimistic. considering.......
> BillK
>
> <https://intelligence.org/2026/09/16/if-anyone-builds-it-everyone-dies-one-year-closer/>
> Quote:
> A lot has changed since September 2025. We’ll do a quick recap,
> consider how the book aged, and then ask where we go from here.
> ---------------------
>
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat
More information about the extropy-chat
mailing list