[ExI] AGI will likely be uncontrollable and very strange

[Keith Henson]

On Fri, Oct 23, 2026 at 11:13 AM Stuart LaForge <avant at sollegro.com> wrote:

> On 2026-10-23 08:45, Keith Henson wrote:
> > I made a case (in a fictional context) 20 years ago that the problem
> > is humans, not AIs. Even the best-aligned AI can result in the
> > biological extinction of humans.
> >
> > "The tata (village) was home to the leopard for the rest of his life.)
>
> "The Clinic Seed" shows a possibility, but I think there would almost
> certainly be holdouts that decide to maintain physical existence warts
> and all and eschew virtual life for duty, preference, or on principle no
> matter how tempting the Matrix might become. There is no reason why AI
> as advanced as the clinic seed AI could not, through genetic engineering
> and selective breeding, create biological or cybernetic transhumans,
> that don't suffer from old age or other diseases and afflictions.
>
> Stuart LaForge
>

The other connected chapters included people who stayed out of the uploaded
state, partly because a story needs characters and uploaded characters are
really hard to write about. But most, 99% did enter the uploaded state
which left the physical world depopulated. I obviously don't know if this
is realistic, it's just a story.

The real future may be stranger than any of us can imagine.

Keith
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20261023/5ee5fc4c/attachment.htm>