[ExI] Unfrendly AI is a mistaken idea.
eugen at leitl.org
Wed Jun 6 10:26:02 UTC 2007
On Wed, Jun 06, 2007 at 08:04:24PM +1000, Stathis Papaioannou wrote:
> It might not happen with humans, because they suffer from desires, a
> bad temper, vanity, self-doubt, arrogance, deceitfulness etc. It's not
People are evolutionary-designed systems. A lot of what people
consider "unnecessary" "flaws" aren't.
> their fault; they were born that way. But why would anyone
> deliberately design an AI this way, and how would an AI acquire these
> traits all by itself?
People will only buy systems which solve their problems,
including dealing with other people and their systems in
an economic framework, which is a special case of an
I'm surprised why so few people are not getting that this
means a lot of constraints on practical artificial systems.
See worse-is-better for a related effect.
Diamond-like jewels are likely doomed.
Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org
ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A 7779 75B0 2443 8B29 F6BE
More information about the extropy-chat