[ExI] Unfrendly AI is a mistaken idea.
stathisp at gmail.com
Sat Jun 9 10:33:13 UTC 2007
On 09/06/07, John K Clark <jonkc at att.net> wrote:
The program is trying to solve a problem, you didn't assign the
> problem, it's a sub problem that the program realizes it must solve before
> it solves a problem you did assign it. In thinking about this problem it
> comes to junction, its investigations could go down path A or path B.
> path will be more productive? You can not tell it, you don't know the
> problem existed, you can't even tell it what criteria to use to make a
> decision because you could not possibly understand the first thing about
> because your brain is just too small. The AI is going to have to use its
> judgment to decide what path to take, a judgment that it developed itself,
> and if the AI is to be a successful machine that judgment is going to be
> right more often than wrong. To put it another way, the AI picked one path
> over the other because one path seemed more interesting, more fun, more
> beautiful, than the other.
OK, but where does that judgement come from?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the extropy-chat