<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I tried it the way you did and GPT-JT is still not able to generate the answer. Are you using GPT-JT or ChatGPT?<div class=""><br class=""></div><div class=""><blockquote type="cite" class=""><div class="WordSection1" style="page: WordSection1;"><div class=""><div class="" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">OK well can we get a personalized parameter sets that GPT derives for us by interacting with us? Seems like it should be creating a matrix of some kind as it learns about me and how I think the world operates. Then we log on, it loads our personal profile matrix or something.</div></div></div></blockquote><div class=""><br class=""></div>The transformer architecture that these models use does not support persistent memory through normal operation. Researchers are currently working on that. The best that can be done now is to give ChatGPT an overview of yourself and your previous conversations at each new conversation. This can be easily programmed to be done automatically behind the scenes, but it is strictly finite memory that must fit within the prompt. The internal matrix weights in the model are static for now.</div><div class=""><br class=""></div><div class="">Theoretically it is actually quite easy to give transformer language model persistent memory. All that needs to be done is to train the model while it is being used. Currently the models are trained once and fine tuned then the parameters are left static. The primary issue I think is cost. Training ChatGPT continuously for each separate user would be VERY costly, although it could be done in principle.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Mar 7, 2023, at 12:29 AM, spike jones via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" class="">extropy-chat@lists.extropy.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta charset="UTF-8" class=""><div class="WordSection1" style="page: WordSection1; caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div class=""><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0in 0in;" class=""><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><b class="">…</b>><span class="Apple-converted-space"> </span><b class="">On Behalf Of<span class="Apple-converted-space"> </span></b>Gadersd via extropy-chat<br class=""><b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [ExI] ChatGPT 'Not Interesting' for creative works<o:p class=""></o:p></div></div></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class="">>…How did you get GPT-JT to output x=-2? I reran it over ten times and it never once got the right answer.<o:p class=""></o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class="">Hi Gadersd, I worded it slightly differently:<o:p class=""></o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">Me: let 2x + 3 = -1. What is x?<o:p class=""></o:p></span></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">GPT:<o:p class=""></o:p></span></div><div style="border: 1pt solid rgb(217, 217, 227); padding: 0in;" class=""><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">To solve for x, we need to isolate x on one side of the equation.<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">Starting with 2x + 3 = -1:<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">Subtracting 3 from both sides:<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">2x = -4<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">Dividing both sides by 2:<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 0in 0in 15pt; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">x = -2<o:p class=""></o:p></span></p><p class="MsoNormal" style="margin: 15pt 0in 0in; font-size: 11pt; font-family: Calibri, sans-serif; border: none; padding: 0in;"><span style="font-size: 10.5pt; font-family: "Segoe UI", sans-serif;" class="">Therefore, x is equal to -2.<o:p class=""></o:p></span></p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div class=""><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class="">>…No, the small models generate output faster than the big models. The small models are not slower version of the big models, they have completely different capabilities. You will never be able to get ChatGPT level output out of a much smaller model. It would be like trying to run modern engineering software on an Atari console: it wouldn’t be slower it just wouldn’t run at all…<o:p class=""></o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class="">OK well can we get a personalized parameter sets that GPT derives for us by interacting with us? Seems like it should be creating a matrix of some kind as it learns about me and how I think the world operates. Then we log on, it loads our personal profile matrix or something. Somehow this thing just hasta learn about us to be a useful companion bot.<o:p class=""></o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class="">spike<o:p class=""></o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div></div></div><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">_______________________________________________</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">extropy-chat mailing list</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><a href="mailto:extropy-chat@lists.extropy.org" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">extropy-chat@lists.extropy.org</a><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a></div></blockquote></div><br class=""></div></body></html>