[ExI] best case scenario for sai

[Ben Zaiboc]

On 26/06/2026 15:46, John Clark wrote:
> A skeptic might argue that maybe there's an upper limit on how intelligent something can be, or at least a limit on how much an intelligence entity can accomplish, but the evidence seems to be pointing in a different direction. The average human has about 86 billion neurons in his head, the average chimpanzee has about 35 billion. So a human has 2.46 times more, but I think you would agree that the amount of change humans have produced in the world is greater than 2.46 times the amount of change chimpanzees have produced in the world.


I suspect that even if there is an upper limit on intelligence (I suppose there must be, in the sense that there's at least a theoretical upper limit on just about everything), we're still very far away from it, and so are our current 'AI' systems. Mr. Jupiter Brain, if he ever exists, will probably be so much more intelligent than we are that there's no way to measure it or guess it.


>
>         >> But not controlled by groups of human beings, they may or may not still exist I don't know, but they will certainly no longer be the ones that make the big decisions in world affairs.
>
>
>     > I'm not sure what you mean by this.
>
>
> It's quite simple, we might still exist, but we will no longer be the boss.


Oh, absolutely. Many people see this as a bad thing, almost reflexively, but I think it's not only a good thing, but a necessary thing. It should be abundantly clear by now that we are not competent, as we are, to ensure even our own survival into the future, never mind our collective well-being. We probably have, or will soon have, all the tools we need, but nowhere near the wisdom to use them effectively (our species name is a bit of a joke, when you think about it).

As I've said before, I think it's going to be all or nothing for the human race, but in any event we won't be the ones making that decision.

-- 
Ben