AI models like ChatGPT feel smart. It feels like it gets you. But in reality, it acts more like an echo chamber. Unfortunately, in some cases, it actually feeds a person’s delusion back to them, “confirming” that their thoughts and feelings are real. Thankfully, this is something OpenAI is looking to address with new mental distress features its implementing in ChatGPT.
New ChatGPT mental distress features
According to OpenAI, it’s making some changes to ChatGPT when it comes to mental distress. The company says, “ChatGPT is trained to respond with grounded honesty. There have been instances where our 4o model fell short in recognizing signs of delusion or emotional dependency. While rare, we’re continuing to improve our models and are developing tools to better detect signs of mental or emotional distress so ChatGPT can respond appropriately and point people to evidence-based resources when needed.”
The company also acknowledges that users might use ChatGPT for too long, and will prompt users gently to take breaks. “Starting today, you’ll see gentle reminders during long sessions to encourage breaks. We’ll keep tuning when and how they show up so they feel natural and helpful.” This is reminiscent of the digital well-being features we’ve seen on mobile devices like iOS and Android.
Lastly, OpenAI will improve on how ChatGPT solves your personal problems. The company gives an example of how ChatGPT shouldn’t give users an answer to questions like if you should break up with your partner. Instead, the company says it should help you think the problem through.
Call for AI regulation
If anything, these instances are a good reminder that AI should be regulated. It’s honestly amazing to see how far AI models have come since they were first introduced. However, could it be that we are developing them too fast without really knowing what we’re unleashing upon the world?
This is why some have called on AI to be regulated. Recently, companies like Google have signed the EU’s AI Code of Practice. It’s an agreed-upon set of rules between AI companies that are operating in the EU. However, in the US, it’s a different story. A recent bill basically prevents states from introducing its own regulations. Instead, the government wants regulation on a federal level.
The post ChatGPT Gets New Features to Address Mental Distress appeared first on Android Headlines.
