[ExI] ai in education

[spike at rainier66.com]

From: John Clark <johnkclark at gmail.com> 



 

 

On Sat, Mar 7, 2026 at 10:46 AM <spike at rainier66.com <mailto:spike at rainier66.com> > wrote:

 

 >>> The AI’s version of safety might mean turning around and destroying the guy who fired the weapon. 

…

> John, with that answer, I completely understand why the military will go nowhere near any company you own or have any influence over.  A soldier does not want the guy in the foxhole next to him pondering values and making nuanced decisions on whether or not to defend him.  He doesn’t want his own weapons doing that either.

 

>…OK I can understand why the military doesn't like that, but you're not in the military so why do you dislike it? John K Clark

 

 

 

The same reasons the military distrusts Anthropic would cause me to distrust it: we can’t be sure it won’t turn on us.  Apparently Amodei gave those in charge an answer similar to the one offered.  

 

As an example, all of humanity is threatened by an AI which might secretly be a religious extremist, looking to destroy all humans who do not share that religion.

 

There is a specific application the military is prioritizing: some way to control the golden dome.  It has THAAD missiles and Patriot missiles in place.  Suppose existing system detects incoming missiles.  How do we prioritize which targets to protect, which to sacrifice, which missiles to fire, which to hold back?  Something like that doesn’t need all the capability of the software we are think of as AI.  It needs more specific training for a more specific task.

 

John you assure us with complete confidence that such a system doesn’t already exist and that anyone who makes it to the top of the military is stupid.  Since those in charge are stupid, how do we figure out which AI to put in charge?  Shall we elect you as dictator of that?  I counter-propose we elect me.

 

spike

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20260307/42eb4f2f/attachment.htm>