[ExI] Digital Consciousness .

Eugen Leitl eugen at leitl.org
Fri Apr 26 09:38:33 UTC 2013


On Fri, Apr 26, 2013 at 02:06:43AM -0700, Gordon wrote:

> > I guess it's okay if an autonomous drone murders you, then.
> > Or is it the operator? Or the maker? Or the developer?
> 
> It's the human computer operator in that case. He or she wants me dead. 

Yes, but with fully autonomous drones there is no operator.
The system cruises around and tries to figure out whom to
kill. How do you even implement utilitarianism? It's
hard to tell how many toddlers it's ok to frag to catch
one Evil, Bad, No-good terrorist.

> But who/what is operating my chess computer when I want to shoot it dead? I think I am the computer operator, but I suppose the human developers and manufacturers are complicit. My chess computer is no more than a blind unconscious tool that I am using against myself for the sport of it.



More information about the extropy-chat mailing list