<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div>On Nov 18, 2010, at 8:18 PM, Keith Henson wrote:</div><br><blockquote type="cite"><div>Genes build motivations into people</div></blockquote><div><br></div><div>Genes may try to motivate people but they often fail because genes are stupid, hence the invention of celibacy and condoms. And I think sometimes (I'm not accusing you of this) people confuse Freud with Mendel; genes are selfish but that does not prove that deep down in our subconscious we must be selfish too. </div><br><blockquote type="cite"><div>to be well regarded by their peers. That seems to me to be a decent meta goal for an AI.</div></blockquote><div><br></div>Perhaps but irrelevant, for a Jupiter Brain a peer would not be a human being.<br><blockquote type="cite"><div> </div></blockquote><blockquote type="cite"><div>Human genes (like *all* genes) do have a static meta goal, that of<br>continuing to exist in future generations. </div></blockquote><div><br></div>But a gene is not a intelligent entity, no intelligence could function with a static meta goal, so imprinting "always obey human beings no matter what" on a smart robot will not work. <br><blockquote type="cite"><div> </div></blockquote><blockquote type="cite"><div>I don't think that striving to be well regarded is an inflexible meta<br>goal. I think it would keep an AI from turning into a psychopathic killer. </div></blockquote><div><br></div>You pointed out that you only need about 20 watts to power the human brain, and I doubt you would argue with my comment that nanotechnology would almost certainly be able to do much better than that or that by then vast amounts of energy would be available; so from one point of view a psychopathic killing spree may be no more controversial than cleaning a dirty surface with some Lysol disinfectant. You and I don't have that viewpoint or anything close to it, but I doubt if a Jupiter Brain would be much interested in our opinion. </div><div><br></div><div> John K Clark <div><br></div><div><br></div></div></body></html>