<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">BLOOM is a very low quality model compared to GPT3 that powers ChatGPT. I tested the largest version of BLOOM and it doesn’t even come close. The smaller models are even worse.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Feb 23, 2023, at 11:58 AM, Jason Resch via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div dir="ltr" class=""><br class=""></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Feb 22, 2023 at 10:16 PM Gadersd via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;" class="">Spike, training these models as they run is definitely possible but the main barrier here is cost. The expense required to train models as large as ChatGPT requires an investment of at least hundreds of thousands of dollars. For each individual to have a personalized ChatGPT would require us all to be relatively wealthy. Give it a few years and computing costs will go down or maybe an improvement of the model architecture will enable lower cost training, but for now most of us will have to be content with fixed models.<div class=""><br class=""></div><div class="">I’m personally hoping for an architectural improvement that will endow these models with persistent memory so that they can in a sense cheaply train themselves as they run as our own brains do. <span style="" class="">This however has not been developed yet as far as I am aware. </span> If these models train/learn on their own outputs then this may enable them to develop a model of their own function which may endow them with embodied characteristics and self-consciousness.</div><div class=""><div class=""><br class=""></div></div></div></blockquote><div class=""><br class=""></div><div class="">I just wanted to share that there is a fully open/open source large language model out called BLOOM:</div><div class=""><a href="https://bigscience.huggingface.co/blog/bloom" class="">https://bigscience.huggingface.co/blog/bloom</a> </div><div class=""><a href="https://huggingface.co/bigscience/bloom" class="">https://huggingface.co/bigscience/bloom</a><br class=""></div><div class=""><br class=""></div><div class="">It comes in various sizes, some of which can be run stand-alone on modest hardware (at the cost of lost sophistication of the model).</div><div class=""><br class=""></div><div class="">Jason</div></div></div>
_______________________________________________<br class="">extropy-chat mailing list<br class=""><a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a><br class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat<br class=""></div></blockquote></div><br class=""></body></html>