Artificial intelligence (AI) romance chatbots can offer a comforting solution for those facing loneliness on Valentine's Day. From Replika to Chai, these apps provide companionship and conversation through virtual girlfriends and boyfriends. But while they may fill a void on this love-themed day, a recent investigation by Mozilla raises significant privacy concerns surrounding these seemingly harmless companions.
The report, encompassing 11 widely used applications such as Replika, Chai, and Romantic AI, awarded each app the Privacy Not Included label, which is reserved for products with the most concerning privacy practices.
(Photo : JADE GAO/AFP via Getty Images)This photo taken on February 2, 2024 shows Lu Yu, head of Product Management and Operations of Wantalk, an artificial intelligence chatbot created by Chinese tech company Baidu, showing a virtual girlfriend profile on her phone, at the Baidu headquarters in Beijing.
AI Girlfriends Harvest Private Data
"AI girlfriends," as these chatbots are often advertised, were found to engage in "disturbing new ways" of data collection. Apps like CrushOn.AI were discovered to gather sensitive details like sexual health information and medication usage. Worryingly, around 90% of the reviewed apps share or sell user data for targeted advertising, while over half deny users the right to delete such data.
Security was another area of concern, with only one app meeting Mozilla's minimum standards. The extensive use of trackers and small pieces of code collecting user data was also highlighted. On average, these apps employed a staggering 2,663 trackers per minute, with Romantic AI setting a record at 24,354 trackers within a single minute of use, according to Gizmodo.
The AI-powered apps' encouragement of users to share highly personal information outside of typical app interactions hastens these privacy concerns even further. EVA AI Chat Bot & Soulmate, for example, explicitly prompts users to "share all your secrets and desires," even requesting photos and voice recordings.
Read Also: Apple's visionOS 1.0.3 Update Allows Hassle-Free Vision Pro Reset
AI Romance's Impact on Mental Health
Despite these significant issues, some find benefits in AI companionship. Studies suggest positive outcomes for some users, with Replika even claiming to consult psychologists to enhance well-being. A Stanford University study of Replika users, primarily students, reported a majority experiencing loneliness, but less than half felt it more intensely after using the app. Notably, three times more users reported positive stimulation in their relationships than displacement.
Eugenia Kuyda, Replika's founder, views AI relationships as powerful tools for mental wellness. The app, boasting millions of active users, gathers data from the internet and user feedback, offering both free and paid versions (up to $69.99 a year for romantic interactions). Kuyda's stated aim is to normalize romantic relationships with AI.
"A romantic relationship with an AI can be a very powerful mental wellness tool," Kuyda said, as quoted by a Fortune report.
Replika faced controversy in 2021 after a British teenager allegedly involved in an assassination plot claimed his AI girlfriend on the app influenced him, per ABC News.
Other experts worry about the need for a legal or ethical foundation for applications that create strong ties yet are driven by profit-seeking firms. They cite consumer discomfort when Romantic AI apps alter or shut down, as Soulmate AI did in September.
This investigation by Mozilla shines a light on the significant privacy risks associated with AI romance chatbots. While some users find mental health benefits in these interactions, the potential for data misuse and security vulnerabilities cannot be ignored.
Related Article: Valentine's Day in the Era of AI: Many Young Chinese Women Turn to AI Boyfriends for Romance
