[ExI] More thoughts on sentient computers

[Gadersd]

There are smaller models that you can run on a single consumer-grade GPU. However, these models are not even close to the quality of ChatGPT. These are toy models that can barely string coherent paragraphs together in some cases.

No one that I am aware of has managed to run a model as powerful as ChatGPT on a consumer-grade computer. The execution speed would be so slow as to be unusable, if it was able to run at all. For example, assuming a personal computer with 15 Tflops it would take over 600 years to train a model as powerful as ChatGPT.

> On Feb 23, 2023, at 10:29 AM, spike jones via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> 
>  
>  
> …> On Behalf Of Gadersd via extropy-chat
> Subject: Re: [ExI] More thoughts on sentient computers
>  
> >…You could certainly download it if OpenAI released it open source, but you would not be able to run it on your personal computer. These models requires VERY expensive GPUs to run. The hardware cost alone runs into the millions.
> 
> OK so it is a calculation speed problem then?  Is a milliGPT theoretically possible?  One that runs on a single GPU and uses ordinary household bandwidth?  I am patient.  If it takes a while to come up with an answer, no worries, so do I.
>  
> spike
>  
>  
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat <http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20230223/d32bd41d/attachment.htm>