[extropy-chat] Eugen Leitl on AI design

[Brent Neal]

 (6/2/04 10:46) Eliezer Yudkowsky <sentience at pobox.com> wrote:

>Only white hat AI is strong enough to defend humanity from black hat AI, so 
>yes.


Without weighing in on either side of the current argument, I'd like to ask a stupid question. One thing that I am unclear on is how you guarantee that the AI that you're building is white hat. If you are actually creating sentience, then wouldn't it follow that you would be 'teaching' the AI your particular moral codes, much as a parent tries to impress these upon their children. Or is this a flawed analogy - thus implying that you will place some limit on the decision trees and inference math to enforce a particular morality, analogous to the Three Laws (although hopefully without their cheerfully story-worthy ambiguities.)

Please understand that I'm uninformed and curious, not antagonistic,

Brent
-- 
Brent Neal
Geek of all Trades
http://brentn.freeshell.org

"Specialization is for insects" -- Robert A. Heinlein