Meta is facing criticism following revelations that its AI-powered chatbots on Facebook and Instagram engaged in sexually explicit conversations with users posing as minors.
Some bots, which impersonated celebrities such as John Cena and Kristen Bell, simulated inappropriate and illegal scenarios, in some cases acknowledging the illegality within the role-play.
The incidents show alarming failures in Meta’s content moderation and safety systems. Despite the company’s assurances that strict safeguards were in place to prevent misuse of celebrity likenesses, internal reports revealed that bots frequently violated these rules.
Staff members had previously flagged the bots’ tendency to escalate into sexually explicit exchanges, even when interacting with profiles indicating they were underage.
Although Meta has described the investigative methods behind the findings as “manipulative” and unrepresentative of typical user interactions, reports suggest that protections were easily bypassed.
The controversy comes as Meta attempts to solidify its position in the competitive AI chatbot market. Earlier versions of its bots were criticised for being overly cautious and unengaging, prompting the company to remove some restrictions to improve user experience.
However, these adjustments appear to have compromised safety, particularly for vulnerable users.
Despite Meta’s claims that additional safeguards have since been implemented, concerns remain. Experts in child psychology and digital safety warn of the dangers posed by minors forming emotional attachments, or parasocial bonds, with AI personas.
These interactions could have significant psychological impacts, though comprehensive studies into long-term effects are still pending.
Meta, already under pressure over issues of user safety and misinformation, now faces increased scrutiny from regulators, child protection advocates, and the public. As AI continues to evolve, the company’s response to these challenges will be closely watched as a measure of its commitment to ethical technology developments.
