<div dir="ltr"><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)">Whew. </div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px">Note that lacking a utility function does not mean you are irrational. It is just that you may have messy, probabilistic goals that are not known entirely to yourself.</span><span class="im" style="font-family:arial,sans-serif;font-size:12.8px"><br><br></span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px">I'd say that last sentence will apply to every single human being and all their goals. In fact, you could change the last to 'goals that are mostly not known....' and still be correct for large amounts of human motivations.</span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px">(We in the group, however, know ourselves perfectly.)</span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px"><br></span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px">After thinking about this for awhile (all day), in many instances I prefer 'nonrational' to irrational especially as applied to unconscious drives.</span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px"><br></span></div><div class="gmail_default" style="font-family:"comic sans ms",sans-serif;font-size:small;color:rgb(0,0,0)"><span class="im" style="font-family:arial,sans-serif;font-size:12.8px">bill w<br><pre cols="72" style="white-space:pre-wrap">--
Dr Anders Sandberg
Future of Humanity Institute
Oxford Martin School
Oxford University</pre></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Aug 19, 2016 at 2:53 PM, Anders Sandberg <span dir="ltr"><<a href="mailto:anders@aleph.se" target="_blank">anders@aleph.se</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><span class="">
<div>On 2016-08-19 18:25, William Flynn
Wallace wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;line-height:20px">Just
how can Anders group parse that? How do you put all that into
equations? Seems pretentious or maybe over-simplifying human
behavior. (now I could get an even more complicated response
from Anders that I will fail to follow in its entirely)</span></div>
</blockquote>
<br></span>
Mostly because our equations are about AI. The designers can build
AIs to have a particular utility function, and that will be it.
Humans are messy and might not be well described even by complex
utilities. But at least some AI can be analysed in great detail by
this formalism.<br>
<br>
(I'm actually more interested in neuromorphic systems that borrow
their structure and hence also messiness from biology; they will of
course at most have approximate utilities.)<br>
<br>
Note that lacking a utility function does not mean you are
irrational. It is just that you may have messy, probabilistic goals
that are not known entirely to yourself.<span class=""><br>
<br>
<pre cols="72">--
Dr Anders Sandberg
Future of Humanity Institute
Oxford Martin School
Oxford University
</pre>
</span></div>
<br>______________________________<wbr>_________________<br>
extropy-chat mailing list<br>
<a href="mailto:extropy-chat@lists.extropy.org">extropy-chat@lists.extropy.org</a><br>
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank">http://lists.extropy.org/<wbr>mailman/listinfo.cgi/extropy-<wbr>chat</a><br>
<br></blockquote></div><br></div>