For those of you who haven’t already seen it, r/accelerate is banning users who think they’ve talked to an AI god.
https://www.404media.co/pro-ai-subreddit-bans-uptick-of-users-who-suffer-from-ai-delusions/
There’s some optimism from the redditors that the LLM folk will patch the problem out (“you must be prompting it wrong”), but assume that they somehow just don’t know about the issue yet.
As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it's clear that they're not aware of the issue enough right now.
There’s some dubious self-published analysis which coined the term “neural howlround” to mean some sort of undesirable recursive behaviour in LLMs that I haven’t read yet (and might not, because it sounds like cultspeak) and may not actually be relevant to the issue.
It wraps up with a surprisingly sensible response from the subreddit staff.
Our policy is to quietly ban those users and not engage with them, because we're not qualified and it never goes well.
AI boosters not claiming expertise in something, or offloading the task to an LLM? Good news, though surprising.