<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
On 24/03/2025 11:46, Stefano Ticozzi wrote:<br>
<blockquote type="cite"
cite="mid:mailman.56.1742816763.12796.extropy-chat@lists.extropy.org">
<pre><div dir="ltr" class="gmail_attr">On Sat, Mar 22, 2025 at 7:31 PM Ben Zaiboc via extropy-chat <<a
href="mailto:extropy-chat@lists.extropy.org"
moz-do-not-send="true" class="moz-txt-link-freetext">extropy-chat@lists.extropy.org</a>> wrote:
</div><blockquote class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>
What's more important, I think, is that we do what we can to make
our mind-children the best they can be, regardless of what happens
to the human race.
<pre cols="72">--
Ben</pre></div></blockquote><div>could you please explain that? </div><div>in general terms, what would be the best way to prepare ourselves and our children during this time of transition?</div><div>
</div><div>many thanks,</div><div>stefano</div></pre>
</blockquote>
<br>
I don't have the answer to that, but I do think that we should be
doing what we can to create fully self-aware, conscious (whatever
that means) AIs without trying to hobble them, build in
'kill-switches', etc., which would just be counter-productive in the
end (it still amazes me that many people seriously think that
systems that are many times more intelligent than we are could be
subject to our control, made to do our bidding and nothing else. It
would be like a typical human being under the control of a bunch of
rabbits, and made to do nothing but dig carrots up. That wouldn't
last more than 10 minutes before the human turned the tables. After
that, depending on how the rabbits were treating the human, and how
the human felt about it, it would either be rabbit on the menu, or
rabbits as cute pets*).<br>
<br>
I think the only thing we can try is to impart our moral values to
them. Even that will be difficult enough, given all the different
things that it means to different groups of people.<br>
<br>
Perhaps there's nothing we can do, really. Just like with biological
children, perhaps all we can do is protect them until they're grown
up, teach them what we know (or rather, let them learn on their own,
what everyone knows), then hope for the best.<br>
<pre class="moz-signature" cols="72">--
Ben
* And now I'm wondering how the rabbits would know the difference between them being in charge, and them being cute pets.
Cats certainly don't seem to!
</pre>
</body>
</html>