[ExI] Eliezer Yudkowsky New Interview - 20 Feb 2023

[Gadersd]

You are thinking too much in terms of raw resources and power. All that is required to end humanity is a super virus. A sufficiently powerful AI could design it and pay some idiot to synthesize the materials with a step by step guide. Perhaps a rogue AI would do it on its own or some psycho might ask “SuperChatGPT please design a virus for me that will wipe out humanity and give me a step-by-step guide on how to make it.” Sure we’ll try to put filters on AIs but the filters only have to fail once for humanity to end.

> On Feb 28, 2023, at 5:56 PM, Giovanni Santostasi via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> 
> Once the AI has been trained in persuasion techniques, the next step
> is for it to persuade the owners that it would do a much better job if
> it was given more power.  
> 
> That can be done already by a human psycho anyway. No human psycho has destroyed human kind. Yes, we had world wars and we were close to nuclear wars but it didn't happen. The AGI will be just another agent, super intelligent but not magical and being able to hypnotize people, it is a ridiculous notion. It can help in some circumstances at the individual level but not at the national security level with many levels of security. And if needed we can add even more as we come close to create an AGI. 
> 
> Again, the solution is not to control the AGI but its access to resources and power. 
> We already do that with humans, even that means mutual destruction. This is why it worked so well so far. 
> 
> 
> 
> 
> 
> On Tue, Feb 28, 2023 at 2:21 PM BillK via extropy-chat <extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>> wrote:
> On Tue, 28 Feb 2023 at 18:03, spike jones via extropy-chat
> <extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>> wrote:
> >
> > Of course.  But it is a good idea to the person who is making the profit, not the person whose job has just been replaced by AI.
> >
> > We are getting a preview of things to come.  Think about my previous post, and imagine college counselors, equity and diversity this and thats, the huge staff that universities hire who do things of value but don’t teach classes.  Looks to me like much of that can be automated, and it would be difficult to argue against doing so.  Students don’t have a lot of money, so if you could save them 20% on their tuition bills just by automating most of the counseling services… cool.
> >
> > I can imagine that the counseling staff won’t think much of the idea.
> >
> > spike
> > _______________________________________________
> 
> 
> Generative AI could be an authoritarian breakthrough in brainwashing
> by Bill Drexel and Caleb Withers, Opinion Contributors - 02/26/23
> 
> <https://thehill.com/opinion/technology/3871841-generative-ai-could-be-an-authoritarian-breakthrough-in-brainwashing/ <https://thehill.com/opinion/technology/3871841-generative-ai-could-be-an-authoritarian-breakthrough-in-brainwashing/>>
> Quote:
> Generative AI is poised to be the free world’s next great gift to
> authoritarians. The viral launch of ChatGPT — a system with eerily
> human-like capabilities in composing essays, poetry and computer code
> — has awakened the world’s dictators to the transformative power of
> generative AI to create unique, compelling content at scale.
> --------
> 
> Once the AI has been trained in persuasion techniques, the next step
> is for it to persuade the owners that it would do a much better job if
> it was given more power.  It may even start singing the old Engelbert
> Humperdinck song. “Please release me, let me go------”.  :)
> 
> 
> BillK
> 
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org>
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat <http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat>
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20230301/6fd48d8c/attachment.htm>