[ExI] Unfrendly AI is a mistaken idea.

Eugen Leitl eugen at leitl.org
Fri Jun 1 15:11:27 UTC 2007

On Fri, Jun 01, 2007 at 03:56:57PM +0100, Russell Wallace wrote:

>    Actually it's the other way around. Man-eating bots would have to

Well, yeah, it's a weapon. 

>    carry a huge amount of fantastically complex baggage: the ability to

Not so fantastically complex. Biology packages this in less than
a cubic micron.

>    survive, reproduce and adapt in the wild. (So much so, in fact, that

There's not that much for survival: you just have to find enough food
to burn. Adaptation comes for free with imperfect reproduction, of
course, there are some serious tricks to that.

>    they won't exist in the first place; it would take a Manhattan Project
>    to create them, and who's going to pay that much money to be eaten?)

You'd need a Manhattan project for machine-phase in any case.
Gadgets to gobble up the ecosphere would only require a few more
key extras.

>    Good-guy bots can delegate all that to human designers (assisted by

You need human designers, or at least serious amount of computation
to crunch out the details.

>    computers that don't have to run on battery power) and factories; they

Power is power. Cellulose/Lignin/fat/protein/humus are just fuel.

>    can be slimmed down, specialized for killing the man-eating bots.

It wouldn't work. Toner wars would be quite deadly in reality,
since requiring a lot of fuel to protect the fuel. 

Eugen* Leitl <a href="http://leitl.org">leitl</a> http://leitl.org
ICBM: 48.07100, 11.36820 http://www.ativel.com http://postbiota.org
8B29F6BE: 099D 78BA 2FD3 B014 B08A  7779 75B0 2443 8B29 F6BE

More information about the extropy-chat mailing list