[ExI] best case scenario for sai, was: RE: Pope Leo and AI

[spike at rainier66.com]

-----Original Message-----
From: extropy-chat <extropy-chat-bounces at lists.extropy.org> On Behalf Of Adrian Tymes via extropy-chat


On Thu, Jun 18, 2026 at 1:07 PM spike jones via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> On Thu, Jun 18, 2026 at 8:47 AM John Clark via extropy-chat
> >>... Nonsense! No AI researcher designed their AI to lie and cheat to 
> > them and to disobey orders... John
>
>> That comment seems unreasonably confident.  An AI researcher may try to create an artificial criminal or artificial miscreant...AI researchers can be bad guys too.




>...Hack bank accounts to fund research into better AI (to hack more bank accounts)?  Adrian

_______________________________________________


That's the kind of creative thinking that has kept me hanging out here for over three decades.  We live in times where software recursive self-improvement has become reality.  We need to be thinking about what happens next, under the very realistic assumption that general superintelligence will become reality soon.  We all know the worst case scenario: silicon-based life takes over, all biological life perishes.  That would be "bad."

But what if... the best case scenario happens.  What is it?  I can imagine a really good one: superhuman AI masters genome editing and nanotechnology, then modifies humanity into a form which coexists with silicon-based technology.  The carbon-based life is then free to do what carbon-based life does best: enjoy itself.  We biologicals are really well-adapted to pleasure.  Perhaps SAI, recognizing this, works out a means whereby we continue existing and breeding, along side of, and in support of, SAI.  That would be cool.

If we establish AI worst case and a best case, then reality must fall somewhere in between.

spike