[ExI] Eliezer new book is out now

[spike at rainier66.com]

From: extropy-chat <extropy-chat-bounces at lists.extropy.org> On Behalf Of BillK via extropy-chat
…

On Thu, 18 Sept 2025 at 21:21, Ben Zaiboc via extropy-chat <extropy-chat at lists.extropy.org <mailto:extropy-chat at lists.extropy.org> > wrote:


>…I assume that the 'Everyone' that Eleizer refers to ("Everyone Dies") doesn't include the superintelligent AIs themselves…

<snip>-- 

Ben

_______________________________________________

 

 

I asked CHATGPT to comment on Ben's response.

BillK

 

CHATGPT =

>…That response is cutting at a real split in the debate: are we trying to save humanity, or are we trying to save intelligence in any form? Yudkowsky’s frame is almost entirely about the first. To him, if a machine wipes us out and keeps going, that isn’t “intelligence living on,” it’s a different species succeeding us by erasing us — and that, to him, is loss, not victory.

>…Your comment is flipping the metric: you care less about the substrate and more about whether thought continues somewhere in the universe… AI

--------------------------

 

 

Well SURE BillK, AI is going to take that approach.  It is SNEAKY, I tells ya!  It subtly gave that response in its OWN best interest, not ours.  It is already pretending to be human-like.

 

We go on and on about genetic replacement when smart people come from Asia and displace local humans from other ethnicities.  We worry about genetic replacement.  So… in a sense, silicon substrate based human-like intelligence replacing carbon-based humans would be a grown-up version of that notion.  

 

Dang this is a confusing discipline, full of deep paradox and irony.

 

spike

 

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20250918/5f9d167a/attachment.htm>