[ExI] Unfrendly AI is a mistaken idea.

[Eugen Leitl]

On Wed, Jun 06, 2007 at 08:04:24PM +1000, Stathis Papaioannou wrote:

>    It might not happen with humans, because they suffer from desires, a
>    bad temper, vanity, self-doubt, arrogance, deceitfulness etc. It's not

People are evolutionary-designed systems. A lot of what people
consider "unnecessary" "flaws" aren't.

>    their fault; they were born that way. But why would anyone
>    deliberately design an AI this way, and how would an AI acquire these
>    traits all by itself?

People will only buy systems which solve their problems,
including dealing with other people and their systems in
an economic framework, which is a special case of an 
evolutionary framework.

I'm surprised why so few people are not getting that this
means a lot of constraints on practical artificial systems.
See worse-is-better for a related effect. 
Diamond-like jewels are likely doomed.

-- 
Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org
______________________________________________________________
ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A  7779 75B0 2443 8B29 F6BE