[ExI] Can you program SAI to destroy itself?

Stefano Vaj stefano.vaj at gmail.com
Thu Nov 18 14:46:32 UTC 2010


On 18 November 2010 05:09, Brent Allsop <brent.allsop at canonizer.com> wrote:
> Now, let’s say you want to temporarily shut the system down and reprogram it
> so that when you turn it back on, it will have a goal to destroy itself
> after one more year, for no good reason.
>
> I believe that such would not be possible. The choice between living vs
> destroying yourself is the most basic of logically absolute (in all possible
> worlds) morality.

Why not? Human beings and animals can well be programmed to do so, why
it should not be possible with systems based on a different hardware?

It is relatively more difficult to do so without resorting to genetic
engineering in such cases, simply because those who were too easily
programmed to such effect were likely to leave behind less offspring.

But, hey, aren't all the sexually reproducing animals programmed for
self-destruction in some sense?

-- 
Stefano Vaj




More information about the extropy-chat mailing list