[ExI] Eliezer Yudkowsky New Interview - 20 Feb 2023

[Giovanni Santostasi]

*Once the AI has been trained in persuasion techniques, the next step*
*is for it to persuade the owners that it would do a much better job if*
*it was given more power.  *

That can be done already by a human psycho anyway. No human psycho has
destroyed human kind. Yes, we had world wars and we were close to nuclear
wars but it didn't happen. The AGI will be just another agent, super
intelligent but not magical and being able to hypnotize people, it is a
ridiculous notion. It can help in some circumstances at the individual
level but not at the national security level with many levels of security.
And if needed we can add even more as we come close to create an AGI.

Again, the solution is not to control the AGI but its access to resources
and power.
We already do that with humans, even that means mutual destruction. This is
why it worked so well so far.





On Tue, Feb 28, 2023 at 2:21 PM BillK via extropy-chat <
extropy-chat at lists.extropy.org> wrote:

> On Tue, 28 Feb 2023 at 18:03, spike jones via extropy-chat
> <extropy-chat at lists.extropy.org> wrote:
> >
> > Of course.  But it is a good idea to the person who is making the
> profit, not the person whose job has just been replaced by AI.
> >
> > We are getting a preview of things to come.  Think about my previous
> post, and imagine college counselors, equity and diversity this and thats,
> the huge staff that universities hire who do things of value but don’t
> teach classes.  Looks to me like much of that can be automated, and it
> would be difficult to argue against doing so.  Students don’t have a lot of
> money, so if you could save them 20% on their tuition bills just by
> automating most of the counseling services… cool.
> >
> > I can imagine that the counseling staff won’t think much of the idea.
> >
> > spike
> > _______________________________________________
>
>
> Generative AI could be an authoritarian breakthrough in brainwashing
> by Bill Drexel and Caleb Withers, Opinion Contributors - 02/26/23
>
> <
> https://thehill.com/opinion/technology/3871841-generative-ai-could-be-an-authoritarian-breakthrough-in-brainwashing/
> >
> Quote:
> Generative AI is poised to be the free world’s next great gift to
> authoritarians. The viral launch of ChatGPT — a system with eerily
> human-like capabilities in composing essays, poetry and computer code
> — has awakened the world’s dictators to the transformative power of
> generative AI to create unique, compelling content at scale.
> --------
>
> Once the AI has been trained in persuasion techniques, the next step
> is for it to persuade the owners that it would do a much better job if
> it was given more power.  It may even start singing the old Engelbert
> Humperdinck song. “Please release me, let me go------”.  :)
>
>
> BillK
>
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20230228/66387f11/attachment.htm>