[ExI] Unfriendly AI is a mistaken idea

[Stathis Papaioannou]

On 29/05/07, Eugen Leitl <eugen at leitl.org> wrote:

>    I partly agree with both Russell and Eugen. Tools can be persons
> >    (manifestly, since we are persons and we were created from non-person
> >    matter by means of evolution), but they don't *necessarily* have to
> be
> >    persons with any particular agenda, no matter how smart they are.
>
> If my tools are persons with a particular agenda, what are you going
> to do about it? What *can* you do about it, assuming you at all know
> what they've been up to?
>

I won't be able to do anything about it if the tools are powerful AND smart
AND have an agenda AND are self-motivated to pursue that agenda no matter
what. Those would be scary tools, for sure.


-- 
Stathis Papaioannou
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20070529/a9ebc7ab/attachment.html>