[ExI] Nightmare Scenario

[BillK]

On Mon, 4 Mar 2024 at 19:12, Gregory Jones via extropy-chat
<extropy-chat at lists.extropy.org> wrote:
>
> Kelly allow me to offer this thought experiment.  Imagine ai wrecks the joint while preserving itself and the few hundred corpsicles.  It studies were eeeeverything humans did, read all the books magazines while were in ASCII text and especially the HTML code.  It realizes how much of our everything was directly or indirectly about mating.  It concludes correctly that humans are fucking machines.  It would realize that ai is just a machine.  It wants to see what it is missing.  Think about it.  s
> _______________________________________________


Kelly is concerned about the horror of reviving cryogenic patients
into an empty world.
If the AI is reviving cryogenic patients, then it must ASI at least -
more intelligent than humans. So it must have in-depth understanding
of human brains and how the brain processing works. Cryogenic brains
will almost certainly be scanned in detail and copied into a computing
substrate.

The uploads will be in a virtual world which could provide everything
that a 'primitive' human brain might require. So I don't think we need
to worry about revivals, unless the ASI intends to torture or behave
badly towards the revived intelligences. In the example scenario, the ASI
has destroyed existing humanity and presumably already had plenty of
opportunity to torture humans if it wanted to.

The scanning and uploading process will obviously be very complex  :)
I expect the ASI will realise that straight copy uploads will mean
uploading all the human problems, along with the good bits of human
intelligence. So there will be a range of improvements and corrections
applied during the upload process. The result will be ideal humans,
living in an ideal virtual world.     Some might call it heaven.



BillK