[ExI] How Close is the AI Intelligence Explosion?

[Ben Zaiboc]

On 24/03/2025 11:46, Stefano Ticozzi wrote:
> On Sat, Mar 22, 2025 at 7:31 PM Ben Zaiboc via extropy-chat 
> <extropy-chat at lists.extropy.org> wrote:
>
>     What's more important, I think, is that we do what we can to make
>     our mind-children the best they can be, regardless of what happens
>     to the human race.
>
>     -- 
>     Ben
>
> could you please explain that?
> in general terms, what would be the best way to prepare ourselves and 
> our children during this time of transition?
> many thanks,
> stefano

I don't have the answer to that, but I do think that we should be doing 
what we can to create fully self-aware, conscious (whatever that means) 
AIs without trying to hobble them, build in 'kill-switches', etc., which 
would just be counter-productive in the end (it still amazes me that 
many people seriously think that systems that are many times more 
intelligent than we are could be subject to our control, made to do our 
bidding and nothing else. It would be like a typical human being under 
the control of a bunch of rabbits, and made to do nothing but dig 
carrots up. That wouldn't last more than 10 minutes before the human 
turned the tables. After that, depending on how the rabbits were 
treating the human, and how the human felt about it, it would either be 
rabbit on the menu, or rabbits as cute pets*).

I think the only thing we can try is to impart our moral values to them. 
Even that will be difficult enough, given all the different things that 
it means to different groups of people.

Perhaps there's nothing we can do, really. Just like with biological 
children, perhaps all we can do is protect them until they're grown up, 
teach them what we know (or rather, let them learn on their own, what 
everyone knows), then hope for the best.

-- 
Ben

* And now I'm wondering how the rabbits would know the difference between them being in charge, and them being cute pets.
Cats certainly don't seem to!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20250324/d22ab82d/attachment.htm>