
News Link • Robots and Artificial Intelligence
Police Are Now Using AI To Create Fake Undercover Profiles Online
• The Free Thought ProjectAmerican police departments near the United States-Mexico border are paying hundreds of thousands of dollars for an unproven and secretive technology that uses AI-generated online personas designed to interact with and collect intelligence on "college protesters," "radicalized" political activists, and suspected drug and human traffickers, according to internal documents, contracts, and communications 404 Media obtained via public records requests.
Massive Blue, the New York-based company that is selling police departments this technology, calls its product Overwatch, which it markets as an "AI-powered force multiplier for public safety" that "deploys lifelike virtual agents, which infiltrate and engage criminal networks across various channels." According to a presentation obtained by 404 Media, Massive Blue is offering cops these virtual personas that can be deployed across the internet with the express purpose of interacting with suspects over text messages and social media.
Massive Blue lists "border security," "school safety," and stopping "human trafficking" among Overwatch's use cases. The technology—which as of last summer had not led to any known arrests—demonstrates the types of social media monitoring and undercover tools private companies are pitching to police and border agents. Concerns about tools like Massive Blue have taken on new urgency considering that the Trump administration has revoked the visas of hundreds of students, many of whom have protested against Israel's war in Gaza.
404 Media obtained a presentation showing some of these AI characters. These include a "radicalized AI" "protest persona," which poses as a 36-year-old divorced woman who is lonely, has no children, is interested in baking, activism, and "body positivity." Another AI persona in the presentation is described as a "'Honeypot' AI Persona." Her backstory says she's a 25-year-old from Dearborn, Michigan whose parents emigrated from Yemen, and who speaks the Sanaani dialect of Arabic. The presentation also says she uses various social media apps, that she's on Telegram and Signal, and that she has US and international SMS capabilities. Other personas are a 14 year-old boy "child trafficking AI persona," an "AI pimp persona," "college protestor" [sic], "external recruiter for protests," "escorts," and "juveniles.
Our reporting shows that cops are paying a company to help them deploy AI-powered bots across social media and the internet to talk to people they suspect are anything from violent sex criminals all the way to vaguely defined "protestors" with the hopes of generating evidence that can be used against them.
"This idea of having an AI pretending to be somebody, a youth looking for pedophiles to talk online, or somebody who is a fake terrorist, is an idea that goes back a long time," Dave Maass, who studies border surveillance technologies for the Electronic Frontier Foundation, told 404 Media. "The problem with all these things is that these are ill-defined problems. What problem are they actually trying to solve? One version of the AI persona is an escort. I'm not concerned about escorts. I'm not concerned about college protesters. So like, what is it effective at, violating protesters' First Amendment rights?"