[ExI] Unfrendly AI is a mistaken idea.

Christopher Healey CHealey at unicom-inc.com
Mon Jun 4 01:03:33 UTC 2007


> > > An AI system set up to do theoretical physics will not
> > > decide to overthrow its human oppressors
> >
> > I'd be willing to bet your life that is untrue.
> 

> Lee Corbin wrote:
>
> Surely Stathis is correct.  Suppose an AI is somehow evolved
> to solve physics questions. Then during its evolution, predecessors
> who deviated from the goal (by wasting time, say, reading
> Kierkegaard) would be eliminated from the "gene pool".
> More focused programs would replace them.
> 

Suppose businesses evolved that attempted to solve physics questions.
During their evolution, one might expect that businesses who deviated
from this goal (by wasting time, say, researching competitors, executing
alliances and buyouts, updating employee skill sets, lobbying for
beneficial legislation, and transplanting themselves to foreign soil)
would be eliminated from the "gene pool".  More directly goal focused
businesses would replace them... 

-Chris






More information about the extropy-chat mailing list