<div dir="ltr"><div class="gmail_default" style="font-family:comic sans ms,sans-serif;font-size:large;color:#000000">Taiwan has the best, eh Spike? Well, what the Hell happened to industrial espionage? Enormous dollars are at stake and there are still secrets? Get a spy. Pay him 50 million dollars - cheap at that price. Why take over a country? (also, a tetrabyte would be part of a fish) </div><div class="gmail_default" style="font-family:comic sans ms,sans-serif;font-size:large;color:#000000"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif;font-size:large;color:#000000">bill w</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 9, 2023 at 11:29 AM spike jones via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg-7177679467635843169"><div lang="EN-US" style="overflow-wrap: break-word;"><div class="m_-7177679467635843169WordSection1"><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal"><u></u> <u></u></p><div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0in 0in"><p class="MsoNormal"><b>…</b>> <b>On Behalf Of </b>William Flynn Wallace via extropy-chat<br><b>Subject:</b> Re: [ExI] chatbots and marketing: was RE: India and the periodic table<u></u><u></u></p></div><p class="MsoNormal"><u></u> <u></u></p><div><div><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">>…<span style="color:black">Spike we have thumb drives that can hold a trilobite. Wait, no. A terabyte. No, wait. That would be a piece of a monster. Anyway, quite a huge amount of memory, and we have memory problems? bill </span>w<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">Billw, it isn’t memory, it is the processing needed to do the training once the trillion tokens are available on that trilobite on that memory stick. ChatGPT doesn’t just look up the answer from a huge text base, it creates probability matrices based on tokens, then looking at all the tokens in the prompt, then calculating what is the most likely next token, stacking them end to end, making sentences and paragraphs.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">Ever since I started learning about the GPT process, I have been seeing parallels (and some important differences) in how that algorithm works when compared and contrasted with a critical breakthrough in classical controls called the Kalman filter. The Kalman filter studies a database and creates a probability matrix of correlation coefficients, then figures out a probabilistic prediction.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">Large language models look at a huge text base, then do their statistical magic to predict the next token.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">As I understand it, the use of tokens (to represent words) makes the resultant LLM work in any language. Cool!<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">So it isn’t so much a memory limit (agreed we have plenty of that) to a processor limit, which is why GPUs, super fast Graphical Processor Units become so critically important, which is why NVIDIA stock went thru the roof recently and its market cap is very close to a trillion dollars and might crash thru that 1E12 at any time…<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><a href="https://companiesmarketcap.com/nvidia/marketcap/" target="_blank">https://companiesmarketcap.com/nvidia/marketcap/</a><u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">…because Nvidia makes the best GPUs and GPUs are necessary to make chatbots and Taiwan manufactures Nvidia’s GPUs and why China will likely grab Taiwan at its first opportunity: Taiwan makes the hardware which the world needs to make good AIs, and he who has the most and best AIs owns the planet.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">Any questions?<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS"">spike<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:18pt;font-family:"Comic Sans MS""><u></u> <u></u></span></p></div></div></div></div>_______________________________________________<br>
extropy-chat mailing list<br>
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a><br>
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br>
</div></blockquote></div>