<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Comic Sans MS";
panose-1:3 15 7 2 3 3 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>>…</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> <b>On Behalf Of </b>Stathis Papaioannou<br><b>Subject:</b> Re: [ExI] malevolent machines<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal style='margin-bottom:12.0pt'><o:p> </o:p></p><div><p class=MsoNormal>On 9 April 2014 09:14, William Flynn Wallace <<a href="mailto:foozler83@gmail.com" target="_blank">foozler83@gmail.com</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='margin-bottom:.25in'><span style='font-size:18.0pt;font-family:"Comic Sans MS";color:#1F497D'>…</span><span style='font-size:18.0pt;font-family:"Comic Sans MS";color:#0B5394'><o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>>…</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#0B5394'>Unless there is something really important that I don't know about computers</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>…<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>Bill there might be something really important that no one knows about computers. Read on, sir.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>>…</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#0B5394'>it seems to me that having a machine 'wake up' like Mike in Heinlein's The Moon is a Harsh Mistress, is just absurd</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>…<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>Plenty of people share that view, but stop short of offering any actual evidence. We know that it hasn’t been done before, however… read on please.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>>…</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#0B5394'>It does what it is programmed to do and cannot do anything else</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>…<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>We already know ways to program software to learn. Examples are learning checkers and chess programs. If one wants to use one’s background computing cycles in this way, one can set the computer to play itself using two different chess programs for instance, and learn by seeing the results how to set parameters. This would be an example of software that is programmed to learn.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'>>…</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#0B5394'> Any other function is just some sort of mystical belief that is paradoxically held by hard scientists. Comments? Billw</span><span style='font-size:14.0pt;font-family:"Comic Sans MS";color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Control software can be made to be self-modifying. It does an action, watches what happens, makes corrective action with a feedback mechanism of some sort, it experiments. Successful algorithms spawn offspring in a process analogous to biological evolution. What part of this seems impossible?<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I can think of no fundamental reason why a mechanical device could not in principle evolve a mind of its own. A mind is a mechanical device, and it has a mind of its own, or is a mind of its own. If you have some new insights on this question, do share please.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>spike<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p></div></div></div><p class=MsoNormal><span style='font-size:10.0pt'><o:p> </o:p></span></p></div></div></div></body></html>