<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b>…</b>> <b>On Behalf Of </b>Adrian Tymes via extropy-chat<br><b>Subject:</b> Re: [ExI] Is AGI development going to destroy humanity?<o:p></o:p></p></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal>On Sat, Apr 2, 2022 at 6:56 AM spike jones via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org">extropy-chat@lists.extropy.org</a>> wrote:<o:p></o:p></p></div><div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in'><p class=MsoNormal>He is far more convinced than most of us that<br>unfriendly AI will destroy humanity.<o:p></o:p></p></blockquote><div><p class=MsoNormal> <o:p></o:p></p></div><div><p class=MsoNormal>>…His main argument seems to be that AI will be unimaginably smarter than humans (achieving superintelligence near-instantaneously through the Technological Singularity process) therefore AI can do literally anything it wants with effectively infinite resources (including time since it will act so much faster than humanity), and unfriendly AI will have the same advantage over friendly AI since it is easier to destroy than to create…<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Ah, kind of an advanced version of Core War? Apologies to anyone who is too young to have gone to college in the 70s. Core War was a kind of machine-code analog of the old Battleship game, where you write a piece of code as compact and elusive as a PT boat but as destructive as a carrier (in software terms.) It was how we had fun before actual video games came along and sex.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Well OK, one can imagine plausibility to that argument. A malicious AI could theoretically wreck the existing software ecosystem. That would be bad. At some point we need to think hard about how we will deal with it if a foreign bad actor were to take down the internet or make it not work right. Consider the US election system alone (never mind our system of commerce for now.) If a bad guy were to make all those voting machines crash the morning of the election and there were not sufficient paper ballots, total chaos would ensue, providing a golden opportunity for China to grab Taiwan while the potential opposition was screaming at each other over who won the election.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Nah. That can’t happen. Besides that is off topic, for it isn’t unfriendly artificial intelligence but rather unfriendly biological intelligence doing the damage. That’s different.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>spike<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div></div></div></div></body></html>