<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><blockquote type="cite" class=""><div dir="ltr" class=""><div class="gmail_default" style="font-family: "comic sans ms", sans-serif; font-size: large;">Why couldn't the big AIs just upload the specialty ones? Or create them itself?</div></div></blockquote><div class=""><br class=""></div><div class="">AI cannot currently create AI in a different way than we can. All the models are created in the same way: training on data. The specialized models are created by fine tuning on data from a particular domain such as chemical engineering.</div><div class=""><br class=""></div><div class=""><font color="#000000" class="">It may be that the general models become good enough on specialized tasks that there is no longer a strong need for specialized models. We are quickly moving in that direction. GPT4 can essentially already do any knowledge task with good competence. In that case the only use cases I can think of for specialized models is privacy, circumventing forbidden topics, or when achieving maximum possible performance is needed.</font></div><div class=""><font color="#000000" class=""><br class=""></font></div><div class=""><font color="#000000" class="">If anyone has unique information such as genealogy or town history that isn’t publicly available, consider putting it up online somewhere so that the large models can consume it on the next internet-wide training run. Then you may find that GPT(5,6,7) knows it well enough.</font></div><div class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Jun 9, 2023, at 9:07 AM, William Flynn Wallace via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="gmail_default" style="font-family: "comic sans ms", sans-serif; font-size: large;">Why couldn't the big AIs just upload the specialty ones? Or create them itself? bill w</div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 9, 2023 at 7:54 AM spike jones via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg2157758774106686990"><div lang="EN-US" style="overflow-wrap: break-word;" class=""><div class="m_2157758774106686990WordSection1"><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0in 0in" class=""><p class="MsoNormal"><b class="">From:</b> extropy-chat <<a href="mailto:extropy-chat-bounces@lists.extropy.org" target="_blank" class="">extropy-chat-bounces@lists.extropy.org</a>> <b class="">On Behalf Of </b>William Flynn Wallace via extropy-chat<br class=""><b class="">Subject:</b> Re: [ExI] chatbots and marketing: was RE: India and the periodic table<u class=""></u><u class=""></u></p></div><p class="MsoNormal"><u class=""></u> <u class=""></u></p><div class=""><div class=""><p class="MsoNormal"><span style="font-size: 18pt; font-family: "Comic Sans MS";" class="">Good answer! Could you create your own bot that researches the area you are interested in that is much better than what the gpt can do? If so, all literature research will be done by your bot, saving you oodles of time. Then you can market it to other researchers in your area who don't want to take the time to create their own bot. Eh? Buttloads of money? Surely companies will spring up creating specialty bots for scientists. Problems - getting irrelevant results, and failing to get relevant ones. Bil</span><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">lw<u class=""></u><u class=""></u></span></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">Ja that is exactly where I am going with your bicycle/jet analogy. A jet can only get you approximately where you need to go. The detail work is better done with the bicycle.<u class=""></u><u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class=""><u class=""></u> <u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">I am told ChatGPT is trained on about a trillion words (or tokens.) OK how much is that? If you start doing some BOTECs, you find out it isn’t that much. The fish bowl contains somewhere around 200 billion words, give or take a factor of 2, but that library where it is housed contained perhaps 2 trillion words back in the olden days, and that library was grossly insufficient for so many areas of research even then. It was filled with material that ChatGPT doesn’t know much about. ChatGPT knows about some of it.<u class=""></u><u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class=""><u class=""></u> <u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">So what if… we could create specialty GPTs for specialty tasks, such as specific genealogy for instance. History of Jackson Mississippi, in obsessive detail for instance, where it knows every street, every person who lived on that street and when they lived there, every graduate from that Brandon High School, every store along the local merchant row, and so on. <u class=""></u><u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class=""><u class=""></u> <u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">ChatGPT would fly us to the approximate area, then more specific, and possibly individually-owned GPTs would navigate the neighborhoods.<u class=""></u><u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class=""><u class=""></u> <u class=""></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"" class="">spike<u class=""></u><u class=""></u></span></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><span style="font-size: 18pt; font-family: "Comic Sans MS";" class=""> </span><span style="font-size:18pt;font-family:"Comic Sans MS"" class=""><u class=""></u><u class=""></u></span></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p><p class="MsoNormal"><u class=""></u> <u class=""></u></p></div></div><div class=""><blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in" class=""><div class=""><p class="MsoNormal"><u class=""></u> <u class=""></u></p></div></blockquote></div></div></div>_______________________________________________<br class="">
extropy-chat mailing list<br class="">
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" class="">extropy-chat@lists.extropy.org</a><br class="">
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank" class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br class="">
</div></blockquote></div>
_______________________________________________<br class="">extropy-chat mailing list<br class=""><a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a><br class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat<br class=""></div></blockquote></div><br class=""></div></body></html>