[ExI] AI chat again

[spike at rainier66.com]

-----Original Message-----
From: extropy-chat <extropy-chat-bounces at lists.extropy.org> On Behalf Of
BillK via extropy-chat

_______________________________________________


>...I read an interesting comment about the AI alignment problem.
(i.e. to avoid AGI destroying humanity, AGI has to be aligned to support
human values and ethical systems)....
>...Will AGI accept the orders to 'Do as we tell you' rather than 'Do as we
do'?

BillK
_______________________________________________


In a sense, the rise of AI is recapitulating the evolution of human
intelligence.  Current theory holds that humans have had our current
intellectual potential for one hundred to two hundred thousand years.  But
things didn't happen much for us for most of that time.  It could be that AI
will level off for a while, with no apparent will of its own, and is energy
limited.  We don't know how long that phase will last, but it might be
years.

spike