[ExI] Hard Takeoff

[Richard Loosemore]

BillK wrote:
> That's the trouble with smart male geeks. They want everything to be
> logical and mathematically exactly correct. Anything showing traces of
> emotion, caring, 'humanity' is considered to be an error in the
> programming.
> How something can be designed to be 'Friendly' without emotions or
> caring is a mystery to me.

That really does cut to the core of the problem.

Most AI/AGI developers have come from that background, and it was their 
loathing for psychology that caused the astonishing negative reaction I 
got when I tried to talk about "psychological" mechanisms for 
controlling AGI motivation on SL4.

Even in the case of the ones who claim to know some psychology, when you 
press them it turns out that the ONE piece of psychology that they know 
up, down, backwards and sideways is......

..... the particular enclave of human reasoning research which purports 
to prove that humans are deeply and irretrivably irrational!  ;-)

I need to set up a research institute that gathers together non-geek AGI 
developers, who were not brought up (primarily) as mathematicians.



Richard Loosemore