[ExI] Language Models on Consumer Hardware

[BillK]

On Sun, 12 Mar 2023 at 22:06, Gadersd via extropy-chat
<extropy-chat at lists.extropy.org> wrote:
>
> Someone managed to run the 13 billion parameter model on a 3.6 GHz processor with 8 GB ram so those phone specs are close! But be aware that GPT3 is 165 billion parameters so we are still a while from running something as big as ChatGPT on a phone. The 13 billion parameter models are approaching usability though.
> _______________________________________________


I suspect the Samsung 3.6 GHz is only for short bursts.
Running at that speed continuous would probably melt the phone!  :)

BillK