[ExI] More thoughts on sentient computers

[Jason Resch]

On Wed, Feb 22, 2023 at 11:08 PM Gadersd via extropy-chat <
extropy-chat at lists.extropy.org> wrote:

> You could certainly download it if OpenAI released it open source, but you
> would not be able to run it on your personal computer. These models
> requires VERY expensive GPUs to run. The hardware cost alone runs into the
> millions.
>
>
My understanding is that while the training of the model cost millions of
dollars of computing power, that the model, once trained, can be run on a
computer with perhaps several thousands of dollars of hardware (around 9
high-end graphics cards). At least this is the case for BLOOM:
https://huggingface.co/bigscience/bloom/discussions/58
You can also rent such hardware from services like AWS, for around $5
dollars per hour, but this runs on the CPU only and is much slower.

Jason
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20230223/25c64e4e/attachment.htm>