[ExI] What might be enough for a friendly AI?.

[Dave Sill]

2010/11/19 John Clark <jonkc at bellsouth.net>:
> There would be absolutely no point in building an AI if you just lock it up
> in a box with no way for the outside world to interact with it.

Sure there would. It could solve problems and teach us.

> A much
> better analogy would be Einstein in charge of weapons development and
> production, world monetary transfer, electric power generation and
> distribution, worldwide communication lines, air traffic control, nuclear
> power plants and pretty much the entire economy.

If you hand it that kind of control, the game is over. You're its
slave, whether you realize it or not.

> When you ask Einstein why
> he made one decision rather than another he tries to tell you but after
> about 20 seconds of his explanation you become totally lost and confused.

The AGI is a supergenius but unable to explain itself?

> You may start to distrust Einstein and be tempted to just shoot him in the
> head but you don't dare because you have become so dependent on him that the
> entire economy, the entire civilization in fact would collapse.

Like I said, at that point you're its slave.

-Dave