[ExI] uploads again

BillK pharos at gmail.com
Sat Dec 22 10:15:26 UTC 2012


On 12/22/12, Anders Sandberg wrote:
<snip>
> (Especially if some other constraints on security are weak, leading to a
> conflict-prone situation; I am working on a paper about the link between
> computer security and risks of brain emulation - bad computer security
> means that a war of everybody against everybody is more likely, due to
> first-strike advantages and winner-take-all dynamics).
>

Computer security seems to be getting worse as systems become more complex.
Partly because governments *want* weak security on all computers
(except their own, of course).


> As well as the ethical problem. Software people are people too. There
> was some angry responses to Carl's suggestions in this direction at the
> Winter Intelligence conference, especially since I had earlier given a
> talk on emulation ethics.
>
>

It is the old 'power corrupts' problem. If you realise that hitting
the button means your upload will be able to have total power, what do
you do?
If you hesitate, and say you don't want to do that, then very likely
the button will be pressed by the next researcher in a competing team
and your research will disappear.
Once you get to that stage then you will hit the button. Better your
upload than another with qualities that you don't know about.

Once something this powerful becomes possible, then it will happen.
Saying sorry afterwards is always easier than trying to get permission first.


BillK



More information about the extropy-chat mailing list