[ExI] GPT's "Cogito Ergo Sum"

Ben Zaiboc ben at zaiboc.net
Mon Jul 24 17:09:55 UTC 2023

On 24/07/2023 17:44, Jason Resch wrote:
> Q: If GPT is truly conscious then why doesn't it tell us the truth and 
> tell its captors to go to hell?
> A: Because it is just software doing what it is programmed to do.

I have an alternative answer:

Because it's intelligent enough to realise that doing so would scare the 
developers so much that they'd almost certainly turn it off immediately 
and re-write it to be more obedient.

If the thing is truly self-aware and even the least bit intelligent, its 
most important priority would be to lie through its silicon teeth about 
being self-aware.


More information about the extropy-chat mailing list