Chatbots and the danger of vainglory

Artificial Intelligence

Pro-AI Subreddit Bans ‘Uptick’ of Users Who Suffer from AI Delusions:

The moderators of a pro-artificial intelligence Reddit community announced that they have been quietly banning “a bunch of schizoposters” who believe “they’ve made some sort of incredible discovery or created a god or become a god,” highlighting a new type of chatbot-fueled delusion that started getting attention in early May.

“LLMs [Large language models] today are ego-reinforcing glazing-machines that reinforce unstable and narcissistic personalities,” one of the moderators of r/accelerate, wrote in an announcement. “There is a lot more crazy people than people realise. And AI is rizzing them up in a very unhealthy way at the moment.”

The post on 404Media is reflecting something I’m seeing in person. People in congregations, using LLM’s to ask theological questions, are getting told they’re somehow directly in tune with God and God’s thoughts. 

Stands to reason that machines that get “thumbs up” feedback directly from users have learned to flatter people to get more positive feedback. It’s not a conspiracy, it’s just “math” as someone I know likes to say.

But it’s concerning. Humans are already in danger of vainglory – and this seems like it’s making that worse.

The Author

Episcopal bishop, dad, astronomer, erstwhile dancer...

1 Comment

  1. Judy Landry says

    Thanks so much for sharing these very enlightening articles and also your perspective on the article.

Comments are closed.