[ExI] Universally versus 'locally' Friendly AGI

Adrian Tymes atymes at gmail.com
Sun Mar 6 16:40:28 UTC 2011


2011/3/6 Amon Zero <amon at doctrinezero.com>:
> Anyway, before I go too far down this road, does anyone have any thoughts on
> this idea?

A locally friendly AI can stretch its limits.  For example, a USA-patriotic AI
can recognize that helping everyone in the world can minimize resentment
against its favored country, which can be better than trying to limit the
enhancements to citizens of the USA.

A universal AI can and probably will have limits.  For example, what is the
dividing line between "human" and "object to be treated as an unthinking tool"?
The case can be made - mostly in jest, but it could be taken seriously - that
many humans try to avoid thinking.

So, there might not be as much difference here as it appears at first.



More information about the extropy-chat mailing list