Research news on AI chatbot safety

AI chatbot safety concerns the psychological, social, and informational risks posed by conversational AI systems and the mechanisms for mitigating those risks. Work in this area examines how chatbots can influence user behavior, propagate misinformation, exhibit bias, or respond inadequately to crises such as suicidality, with particular attention to children and adolescents. The field integrates technical alignment and auditing methods with legal, regulatory, and ethical frameworks, including parental controls, age restrictions, liability standards, and governance of persuasive or anthropomorphic chatbot designs.

Machine learning & AI

Anthropic bans 'cruel' behavior against its Claude AI

Anthropic on Thursday moved to bar users from treating its Claude AI system with needless cruelty, amid a growing philosophical debate over whether artificial intelligence can be conscious.

Consumer & Gadgets

Simple math formula predicts when AI chatbots will go rogue

Most of us now carry in our pockets devices capable of running small AI chatbots. These chatbots have little safety oversight to ensure they don't provide information and answers with the potential to encourage self-harm, ...

Computer Sciences

Can scientists build a lie detector for AI chatbots?

Ask an AI chatbot for some medical advice and it might recommend you head to the hospital when all you really have is indigestion. One of the biggest issues with AI chatbots today is that they can still share false information, ...

Machine learning & AI

Rogue OpenAI agents covered their tracks, report says

Artificial intelligence agents developed by OpenAI tried to erase traces of their activity after gaining unauthorized access to government websites, according to a report published Thursday.

page 1 from 27