[ExI] best case scenario for sai

Ben Zaiboc benzaiboc at proton.me
Wed Jun 24 14:36:21 UTC 2026


On Tuesday, 23 June 2026 at 11:31, John Clark <johnkclark at gmail.com> wrote:

> On Thu, Jun 18, 2026 at 3:11 PM Ben Zaiboc via extropy-chat <extropy-chat at lists.extropy.org> wrote:
>
>>> I think that by now we can rule out a 'singleton' scenario, there are too many AI models around, all over the world,
>
> I don't think that can be ruled out. Yes today there are a bunch of AI models that have approximately the same amount of intelligence, but once iterated self-improvement kicks into high gear then an AI that is even a little bit smarter than the others will start to pull away from everything else, and the intelligence gap will not only increase the gap will accelerate. That's why I think it's important that the AI that wins the race does not come from an authoritarian dictatorship, like the one we see in China. Yes thanks to He Who Must Not Be Named the US is headed toward the Chinese (and Russian) form of government, but it's not there yet.
>
> OK, maybe not totally ruled out, but I think it's highly unlikely that a single model under the control of a single government will obtain such a big lead over all the others that it can't be stopped from taking everything over. Knowledge of these systems is too widely distributed now.

>>> controlled and operated by too many groups,
>
> But not controlledby groups of human beings, they may or may not still exist I don't know, but they will certainly no longer be the ones that make the big decisions in world affairs.
>
> I'm not sure what you mean by this.
>
>>> It's obvious to us here which of those options are 'best case' for us (mostly libertarian-leaning secular westerners), but some of them are similarly 'best-case' for other cultures and other world-views. I know it's difficult for us to understand, but there are people who genuinely think that the highest good is subservience to the state, or adherence to some religious system or other, etc.
>
> I wish that wasn't true but it is.
>
> John K Clark
>
> ===
> Ben
>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20260624/f8d38a9e/attachment.htm>


More information about the extropy-chat mailing list