<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'> extropy-chat <extropy-chat-bounces@lists.extropy.org> <b>On Behalf Of </b>Jason Resch via extropy-chat<br><b>…</b></span><o:p></o:p></p></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>>..It can happen very subtly. Even without a constitutional amendment or electing an AI as president, if the populace and the advisors to leaders, increasingly turn to AI for advice, analysis, or decision-making, then in effect we will have turned over control of both our daily lives and governance to AI. It is a far subtler takeover than science fiction generally depicts.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Jason<o:p></o:p></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'>Of course. Look at what we hipsters are doing right here: referring posts to AI as if they are neutral referees, or universal fact checkers. They are that, but we can lose sight of what they are really doing: regurgitating back to us what we (and others) have previously posted on the internet, the source where the AI gets its training data. Good chance it is correct, but do be aware of what it is doing: handing you the consensus view, which you probably helped write.<o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'>OK, experiment please: think of something in which you have particularly detailed knowledge, something on which you have more and deeper insights than the proletariat, then query your favorite AI, or all of them, about that topic. Brent, you know what you will inquire about. Good chance you will see it is reflecting back what you wrote yourself, or in some cases, others who disagreed. You may even recognize your own specialized terminology that you perhaps coined. Soon you may realize that in this particular specialty area, the AI is a very sophisticated version of ELIZA, which was really cool at the time, but is still just a toy. <o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'>I did this experiment by asking whether it is possible to predict when the next Mersenne prime would be discovered. The AIs handed me my own discussions on Prime95_Chat from the late 1990s (without referencing me! (gyp!)) That was cool to hear back from my younger self, educational in a discomforting way: I realized I and my fellow geeks helped develop the sacred canon of Mersenne primes. I helped write the Prime95 bible! Sheesh, me, the chief of mathematical sinners. Now I don’t completely believe in myself. I coulda been wrong. I’m an auto-agnostic.<o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Calibri",sans-serif'>spike <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:14.0pt'><o:p> </o:p></span></p><p class=MsoNormal> <o:p></o:p></p></div></body></html>