<div dir="ltr"><i>You will see early versions of gpt-4, despite not yet being trained on images at the time, was still able to draw images of various objects in various graphical languages. This shows that the LLM can learn more than just words. It somehow gained an ability to picture things in its head.<br></i><br>YES !<div>And this is what the people that dismiss NLMs do not understand. There are many emergent properties coming out of them that are not easy to predict from a simple statistical pattern prediction. For example, it is not obvious that grammar could be inferred from these statistical patterns. In fact, if you asked language experts many years ago if NLM could derive grammar from the statistical patterns the consensus was no, they could not. <br>They were wrong. <br>But NLMs do understand grammar and many other things. They even developed a theory of mind. This without any referent at all. So it is logical that they can understand in other conceptual domains without the use of referents. These language experts should actually develop better theories about how language works instead of insisting on human exceptionality. <br><br>Giovanni </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 23, 2023 at 6:18 PM Gordon Swobe via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 23, 2023 at 6:29 PM Jason Resch via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 23, 2023, 7:33 PM Adrian Tymes via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">On Thu, Mar 23, 2023 at 4:11 PM Jason Resch via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" rel="noreferrer" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Mar 23, 2023, 6:39 PM Adrian Tymes via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" rel="noreferrer" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">On Thu, Mar 23, 2023 at 1:02 PM Jason Resch via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" rel="noreferrer noreferrer" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div>Others had argued on this thread that it was impossible to extract meaning from something that lacked referents. it seems you and I agree that it is possible to extract meaning and understanding from a data set alone, by virtue of the patterns and correlations present within that data.<br></div></div></blockquote><div><br></div><div>With the caveat that referents are themselves data, so if we include appropriate referents in that data set then yes. Referents are often referenced by their correlations and matching patterns.</div></div></div></blockquote></div></div><div dir="auto"><br></div><div dir="auto">I don't understand what you are saying here.</div></div></blockquote><div><br></div><div>Do you agree that referents are data? If not, why not?</div><div></div></div></div></blockquote></div></div><div dir="auto"><br></div><div dir="auto"><br></div><div dir="auto">What is a referent? My understanding was that according to you and Adrian, things like dictionaries and Wikipedia text lack referents since they are just bodies of text.</div></div></blockquote><div><br>I think it was Adrian who asked you that question. A referent as I use the term is something that exists outside of language to which a word refers. You have an apple in your hand and you say "this is an apple." The apple in your hand is the referent that corresponds to your word "apple." <br><br>As for whether referents are data, it is unclear to me how referents could be data. I am inclined to say no but I am not sure what Adrain is getting at here.<br> <br> -gts</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
</blockquote></div></div>
_______________________________________________<br>
extropy-chat mailing list<br>
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a><br>
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br>
</blockquote></div>