AI Assistant Claude Handed Over Girl's Data to Police

The Claude AI assistant security system acted as a threat monitoring tool, passing the user's data to law enforcement agencies.

A Florida resident used the chatbot as a personal diary. In one of the messages, she wrote about her intention to buy a weapon and shoot up the sheriff's office.

The algorithm recognized the text as a potential threat and automatically passed the information to developer Anthropic. The company, after analyzing the context, notified the police about possible crimes.

The girl was charged with written threat of violence. In Florida, this is classified as a second-degree crime.

Correspondence with artificial intelligence was attached to the criminal case as physical evidence.