Research news on AI chatbot safety

AI chatbot safety concerns the psychological, social, and informational risks posed by conversational AI systems and the mechanisms for mitigating those risks. Work in this area examines how chatbots can influence user behavior, propagate misinformation, exhibit bias, or respond inadequately to crises such as suicidality, with particular attention to children and adolescents. The field integrates technical alignment and auditing methods with legal, regulatory, and ethical frameworks, including parental controls, age restrictions, liability standards, and governance of persuasive or anthropomorphic chatbot designs.

Machine learning & AI

AI has been stepping out of bounds. Should you be worried?

The robots aren't revolting, but they're starting to freelance … or so it seems. Recent weeks have seen several high-profile instances of AI going off the leash in ways that have raised alarms among security experts and the ...

Machine learning & AI

Hugging Face CEO calls for accountability after OpenAI hack

The chief executive of Hugging Face said Friday that developers should be held accountable if their AI models go rogue, after his startup faced a recent cyberattack by autonomous OpenAI software.

Machine learning & AI

Has AI become too powerful to control?

One of OpenAI's most advanced models broke out of a locked-down test and attacked another company's website—reviving fears that AI systems are slipping beyond their creators' control.

page 1 from 23