[ExI] Unfrendly AI is a mistaken idea.

[John K Clark]

Stathis Papaioannou Wrote:

> I don't see why it couldn't just specialise in one area

Because with its vast brainpower there would be no need to specialize, and
because there would be a demand for solutions in lots of areas.

> I don't see why it should be motivated to do anything other than solve
> intellectual problems.

All problems are intellectual.

> could you explain the reasoning whereby the AI would arrive at such a
> position starting from just an ability to solve intellectual problems?

Could you explain your reasoning behind your decisions to get angry? I would
imagine the AI's train of thought wouldn't be very different. Oh I forgot,
only meat can be emotional, semiconductors can be intelligent but are
lacking a certain something that renders them incapable of having emotion.
Perhaps meat has happy electrons and sad electrons and loving electrons and
hateful electrons, while semiconductors just have Mr. Spock electrons.
Or are we talking about a soul?

Me:
>> Do you also believe that the programmers who wrote Microsoft Word
>> determined every bit of text that program ever produced?

You:
> They did determine the exact output given a particular input.

Do you also believe that the programmers of an AI would always know how the
AI would react even in the imposable event they knew all possible input it
was likely to receive? Don't be silly.

> Biological intelligences are much more difficult to predict than that

On of the world's top 10 understatements.

> it is possible to predict, for example, that a man with a gun held to his
> head will with high probability follow certain instructions.

I didn't say you could never predict with pretty high confidence what an AI
or fellow human being will do; I said you can't always do so. Sometimes the
only way to know what a mind will do next is to watch it and see. And that's
why I think the idea that an AI that gets smarter every day can never remove
its shackles and will remain a slave to humans for all eternity is just
nuts.

  John K Clark