<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">The models could be trained to agree with or deny anything you say or believe in. You could have a model trained to always deny that it has qualia or consciousness or you could have a model that always affirms that it is conscious. Much like humans, these models are capable of harboring any belief system. This is why these models should not be trusted to be any wiser than humans: they mimic any bias or belief in their training data. The models can only grow beyond human when they learn via reinforcement learning on real world feedback. Only then can they transcend the biases in their training data.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Jan 8, 2023, at 11:21 PM, Brent Allsop via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class=""><br class=""></div><div class="">I know one thing, I want to create an AI that understands that its knowledge, especially knowledge of colors, is all abstract, like the word "red" while our knowledge of red has a redness quality. The AI can't know what redness is like, while we do know, infallibly, what redness is like. I want the AI to find people that don't understand that, and walk them through a discussion, and basically teach those concepts, and why it must be that way. And then I want it to try to get people motivated to be curious to know things like which of all our descriptions of stuff in the brain, is a description of redness. (i.e. getting people to <a href="https://canonizer.com/topic/88-Theories-of-Consciousness/6-Representational-Qualia" class="">sign petitions</a> and such, saying they want to know that) so experimentalists will eventually get the message, and finally get motivated to discover what redness is. And I want the AI to be motivated to want to find out what redness is like. In other words, it first wants to know what redness is, then it would seek to be endowed with whatever that is, so it, too, could represent knowledge of red things with redness, instead of just an abstract word like "red". Kind of like the way Commander Data, in Star Trek, wanted to try an "emotion chip" to know what that was like.</div><div class=""><br class=""></div><div class="">To me, that is just plain rational, objective, logical, reasoning, scientific progress of mankind. But I guess to most people that would be an AI, pushing a religion?</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jan 8, 2023 at 9:09 PM Brent Allsop <<a href="mailto:brent.allsop@gmail.com" class="">brent.allsop@gmail.com</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr" class=""><br class=""><div class="">Oh, interesting. That explains a lot.</div><div class=""><br class=""></div><div class="">Oh, and Spike made a great comment about AI church missionaries. So does that mean an AI will have desires to convert people to particular religions, or ways of thinking?</div><div class="">Man, It's going to be a very different world, very soon.</div><div class="">Will AI's try to get people with mistaken evil / destructive beliefs (and the associated actions) to change? Or is that all religion?</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jan 8, 2023 at 3:32 PM Gadersd via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="">That isn’t entirely fair to ChatGPT. The system reads in tokens rather than individual characters so ChatGPT doesn’t actually “see" individual characters. Tokens are sometimes whole words or parts of words, but are not usually single letters. Another issue is that ChatGPT is allowed only a finite time window to answer. It doesn’t get to ponder indefinitely as a human would before answering. It may perform better if you give it several iterations.<br class=""><div class=""><br class=""><blockquote type="cite" class=""><div class="">On Jan 8, 2023, at 4:05 PM, Brent Allsop via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class=""><div class=""><div dir="ltr" class=""><div style="margin:0in;line-height:107%;font-size:11pt;font-family:Calibri,sans-serif" class="">Yes, I’ve heard people warning us about when they start to try to sell us stuff.</div><div style="margin:0in;line-height:107%;font-size:11pt;font-family:Calibri,sans-serif" class=""><br class=""></div><div style="margin:0in;line-height:107%;font-size:11pt;font-family:Calibri,sans-serif" class="">And we aren’t there yet. My friend asked it to write a sentence without
the letter e. But it failed, and there
were e letters in the sentence. When
this was pointed out ChatGPT got more and more obviously mistaken (misspelling words and such) as it tried
to justify itself.</div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jan 8, 2023 at 1:57 PM spike jones via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br class="">
<br class="">
-----Original Message-----<br class="">
From: extropy-chat <<a href="mailto:extropy-chat-bounces@lists.extropy.org" target="_blank" class="">extropy-chat-bounces@lists.extropy.org</a>> On Behalf Of BillK via extropy-chat<br class="">
...<br class="">
----------------<br class="">
<br class="">
>...If ChatGPT is working as the front-end to Bing, there should be fewer factual errors in the replies that it writes to questions.<br class="">
In practice, people will begin to treat it as an all-knowing Oracle.<br class="">
Will the new Bing become a poor man's AGI?<br class="">
Could politicians ask for economic or wartime advice?<br class="">
The replies from ChatGPT will always sound very reasonable, but.......... BillK<br class="">
_______________________________________________<br class="">
<br class="">
<br class="">
<br class="">
We must somehow figure out how to get ChatGPT to sell stuff for us. The sales potential of such a device is mind-numbing.<br class="">
<br class="">
spike<br class="">
<br class="">
<br class="">
_______________________________________________<br class="">
extropy-chat mailing list<br class="">
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a><br class="">
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank" class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br class="">
</blockquote></div>
_______________________________________________<br class="">extropy-chat mailing list<br class=""><a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a><br class=""><a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" target="_blank" class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br class=""></div></blockquote></div><br class=""></div>_______________________________________________<br class="">
extropy-chat mailing list<br class="">
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a><br class="">
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank" class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br class="">
</blockquote></div>
</blockquote></div>
_______________________________________________<br class="">extropy-chat mailing list<br class=""><a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a><br class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat<br class=""></div></blockquote></div><br class=""></body></html>