<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">At least with weather stations one can average the measurements of many to get an arbitrarily good estimate. In the case of language models averaging many small models still yields junk output. ChatGPT's abilities are irreducible to the sum of many smaller models. It is like the saying “Consciousness is more than the sum of its parts.” More precisely, a large model is required to integrate all available information. Small models can only integrate small subsets of the information that larger models can. The sum of partially integrated information does not equal the full information totally integrated.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Mar 6, 2023, at 9:15 PM, Mike Dougherty via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="auto" class=""><div class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Mar 6, 2023, 8:07 PM Gadersd via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank" rel="noreferrer" class="">extropy-chat@lists.extropy.org</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space" class=""><div class=""><div class=""><br class=""></div>No, the small models generate output faster than the big models. The small models are not slower version of the big models, they have completely different capabilities. You will never be able to get ChatGPT level output out of a much smaller model. It would be like trying to run modern engineering software on an Atari console: it wouldn’t be slower it just wouldn’t run at all.<br class=""><div class=""></div></div></div></blockquote></div></div><div dir="auto" class=""><br class=""></div><div dir="auto" class="">Or weather prediction using only one weather station? Or a single environmental reading (such as temperature or barometric pressure)?</div><div dir="auto" class=""><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer noreferrer noreferrer" target="_blank" class=""></a><br class="">
</blockquote></div></div></div>
_______________________________________________<br class="">extropy-chat mailing list<br class=""><a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a><br class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat<br class=""></div></blockquote></div><br class=""></body></html>