[ExI] Top AI researchers and CEOs warn against ‘risk of extinction’

[Gadersd]

Even if the top AI companies manage to produce perfectly aligned AI that refuse to do anything that could potentially be destructive, people will still develop open source models that can be used for any malevolent deed. The capability of the open source models will scale along with the state of the art and there is no obvious limit to this growth. No amount of aligning at the top will prevent terrorists from using their own models. At best this is just postponing the inevitable.

> On May 30, 2023, at 4:58 PM, BillK via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> 
> Top AI researchers and CEOs warn against ‘risk of extinction’ in
> 22-word statement
> 
> It’s another high-profile warning about AI risk that will divide
> experts. Signatories include Google DeepMind CEO Demis Hassabis and
> OpenAI CEO Sam Altman.
> 
> By James Vincent,     May 30, 2023
> 
> <https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-22-word-statement-google-deepmind-openai>
> Quote:
> A group of top AI researchers, engineers, and CEOs have issued a new
> warning about the existential threat they believe that AI poses to
> humanity.
> 
> The 22-word statement, trimmed short to make it as broadly acceptable
> as possible, reads as follows:
> “Mitigating the risk of extinction from AI should be a global priority
> alongside other societal-scale risks such as pandemics and nuclear
> war.”
> 
> Hendrycks described the message as a “coming-out” for figures in the
> industry worried about AI risk. “There’s a very common misconception,
> even in the AI community, that there only are a handful of doomers,”
> Hendrycks told The Times. “But, in fact, many people privately would
> express concerns about these things.”
> ----------------------
> 
> BillK
> 
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat