<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Calibri",sans-serif;
mso-ligatures:standardcontextual;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72" style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>I had an idea on which I need help.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>In this forum, we have posted for decades about the singularity, with a wide spectrum of views about the future, ranging from the most pessimistic, Eliezer’s If Anyone (etc) to the most optimistic, John’s I for one, welcome our new AI overlords. I have a moderate view (which is no surprise (being the record holder for most extremely moderate person)) opining that SAI will likely bring bad things to humanity, but it is the only plausible path to individual immortality, the only plausible path, no exceptions.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>OK then. We need a more formal way to refer to these views than Eliezer’s pessimism, John’s optimism and spike’s moder… what is the noun form meaning having an extreme middle view? Moderism? Modism? Moderatude?<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>One possible way to organize the spectrum is analogous to how an engineering specification is structured, with each requirement having a unique number, or a series of numbers separated by dots. For instance, a requirement for maximum temperature might be 4.3.12.2: The subsystem must operate at 65C. In that case, section 4.3 contains the environmental requirements, 4.3.12 are the thermal requirements, 4.3.12.1 and 4.3.12.2 are low and high temperature operating requirements for instance.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>OK now let the first number in this taxonomy describe the AI being aligned or malign. The 1.x scenarios are ones where AI likes humans and wants to help us. The 2.x are those where AI doesn’t like humans and wants to harm or slay us. Let section 3.x be those cases where there are mixed views on the part of AI toward humans, such as AI weapons, which like their side but will slay the other guys. Let 4.x be scenarios where AIs have no will at all, but can be harmful or helpful, but don’t care about humans or even know what we are. They are just data doing what data does.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>Ideally we want this taxonomy to have structure, so that the second number describes something similar across the four main divisions. Are there better ways to organize this taxonomy? If we do this right, could we assign a number to every SciFi story which includes AI?<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'>spike<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt'><o:p> </o:p></span></p></div></body></html>