[ExI] GPT-4 becomes 30% more accurate when asked to critique itself

[Tara Maya]

This quality of self-reflexion seems to me to be critical to true consciousness. Very, very interesting!

> On Apr 3, 2023, at 4:17 AM, BillK via extropy-chat <extropy-chat at lists.extropy.org> wrote:
> 
> GPT-4 becomes 30% more accurate when asked to critique itself
> By Loz Blain      April 03, 2023
> 
> <https://newatlas.com/technology/gpt-4-reflexion/>
> 
> Quotes:
> Even if the unlikely six-month moratorium on AI development goes
> ahead, it seems GPT-4 has the capability for huge leaps forward if it
> just takes a good hard look at itself. Researchers have had GPT
> critique its own work for a 30% performance boost.
> 
> "It’s not everyday that humans develop novel techniques to achieve
> state-of-the-art standards using decision-making processes once
> thought to be unique to human intelligence," wrote researchers Noah
> Shinn and Ashwin Gopinath. "But, that’s exactly what we did."
> 
> The "Reflexion" technique takes GPT-4's already-impressive ability to
> perform various tests, and introduces "a framework that allows AI
> agents to emulate human-like self-reflection and evaluate its
> performance." Effectively, it introduces extra steps in which GPT-4
> designs tests to critique its own answers, looking for errors and
> missteps, then rewrites its solutions based on what it's found.
> 
> More and more often, the solution to AI problems appears to be more
> AI. In some ways, this feels a little like a generative adversarial
> network, in which two AIs hone each other's skills, one trying to
> generate images, for example, that can't be distinguished from "real"
> images, and the other trying to tell the fake ones from the real ones.
> But in this case, GPT is both the writer and the editor, working to
> improve its own output.
> ---------------
> 
> It's just saying 'Are you sure about that?' to itself.  :)
> 
> BillK
> 
> _______________________________________________
> extropy-chat mailing list
> extropy-chat at lists.extropy.org
> http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat