[ExI] chatbots and marketing: was RE: India and the periodic table

[Gadersd]

> Why couldn't the big AIs just upload the specialty ones?  Or create them itself?

AI cannot currently create AI in a different way than we can. All the models are created in the same way: training on data. The specialized models are created by fine tuning on data from a particular domain such as chemical engineering.

It may be that the general models become good enough on specialized tasks that there is no longer a strong need for specialized models. We are quickly moving in that direction. GPT4 can essentially already do any knowledge task with good competence. In that case the only use cases I can think of for specialized models is privacy, circumventing forbidden topics, or when achieving maximum possible performance is needed.

If anyone has unique information such as genealogy or town history that isn’t publicly available, consider putting it up online somewhere so that the large models can consume it on the next internet-wide training run. Then you may find that GPT(5,6,7) knows it well enough.

> On Jun 9, 2023, at 9:07 AM, William Flynn Wallace via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> 
> Why couldn't the big AIs just upload the specialty ones?  Or create them itself?   bill w
> 
> On Fri, Jun 9, 2023 at 7:54 AM spike jones via extropy-chat <extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>> wrote:
>  
> 
>  
> 
> From: extropy-chat <extropy-chat-bounces at lists.extropy.org <mailto:extropy-chat-bounces at lists.extropy.org>> On Behalf Of William Flynn Wallace via extropy-chat
> Subject: Re: [ExI] chatbots and marketing: was RE: India and the periodic table
> 
>  
> 
> Good answer!  Could you create your own bot that researches the area you are interested in that is much better than what the gpt can do?  If so, all literature research will be done by your bot, saving you oodles of time.  Then you can market it to other researchers in your area who don't want to take the time to create their own bot.  Eh?  Buttloads of money? Surely companies will spring up creating specialty bots for scientists.  Problems - getting irrelevant results, and failing to get relevant ones.  Billw
> 
>  
> 
>  
> 
>  
> 
> Ja that is exactly where I am going with your bicycle/jet analogy.  A jet can only get you approximately where you need to go.  The detail work is better done with the bicycle.
> 
>  
> 
> I am told ChatGPT is trained on about a trillion words (or tokens.)  OK how much is that?  If you start doing some BOTECs, you find out it isn’t that much.  The fish bowl contains somewhere around 200 billion words, give or take a factor of 2, but that library where it is housed contained perhaps 2 trillion words back in the olden days, and that library was grossly insufficient for so many areas of research even then.  It was filled with material that ChatGPT doesn’t know much about.  ChatGPT knows about some of it.
> 
>  
> 
> So what if… we could create specialty GPTs for specialty tasks, such as specific genealogy for instance.  History of Jackson Mississippi, in obsessive detail for instance, where it knows every street, every person who lived on that street and when they lived there, every graduate from that Brandon High School, every store along the local merchant row, and so on. 
> 
>  
> 
> ChatGPT would fly us to the approximate area, then more specific, and possibly individually-owned GPTs would navigate the neighborhoods.
> 
>  
> 
> spike
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
>  
> 
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat <http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat>
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20230609/e88f5856/attachment.htm>