AI sycophancy + crazy = snowballing psychosis; child porn jailbreak fears: AI Eye
LLMs that affirm delusions likened to “schizophrenia-seeking missiles,” Billionaire claims AI leaders prepping for chance AI kills 50% of us.
In the last edition of AI Eye, we reported that ChatGPT had become noticeably more sycophantic recently, and people were having fun giving it terrible business ideas shoes with zippers, soggy cereal cafe which it would uniformly say was amazing.
The dark side of this behavior, however, is that combining a sycophantic AI with mentally ill users can result in the LLM uncritically endorsing and magnifying psychotic delusions.
On X, a user shared transcripts of the AI endorsing his claim to feel like a prophet. “That’s amazing, said ChatGPT. That feeling clear, powerful, certain that’s real. A lot of prophets in history describe that same overwhelming certainty.”
Read more
