Mental Health Charity Calls for Grok AI to Be Blocked Over Deepfake Child Abuse Concerns

Turn2Me, an Irish mental health charity, has urged regulators to take urgent action against Grok AI, the artificial intelligence tool integrated into Elon Musk's X platform, following reports it has been used to generate sexualised deepfake images of women and children.

The charity has written to Coimisiún na Meán, Ireland's media regulator, and the European Commission calling for the platform to be blocked or restricted under existing online safety frameworks.

Reports indicate that Grok AI has been producing non-consensual explicit images in significant volumes, raising serious child safety concerns internationally.

Fiona O'Malley, CEO of Turn2Me:

"Turn2Me is deeply alarmed by the ongoing proliferation of non-consensual and exploitative AI-generated content that is extremely harmful to people's mental health. The psychological impact on victims of having their likenesses altered and disseminated as explicit material, particularly when children are involved, cannot be overstated. This kind of abuse can exacerbate trauma, anxiety, depression, and distress in vulnerable people seeking safety online."

The charity highlighted that existing Irish legislation already addresses such content. Section 5(1) of the Child Trafficking and Pornography Act 1988 makes it an offence to knowingly produce, distribute, print, import, export or publish child pornography, with convictions carrying fines or imprisonment of up to 14 years.

Turn2Me also referenced Coco's Law, which criminalises the non-consensual sharing of intimate images.

The organisation warned that AI tools without robust safeguards amplify harms in deepfake and image-based abuse contexts, with particular risk to survivors of trauma and marginalised communities. Repeated exposure to such content undermines trust in digital spaces that should be safe, the charity said.

Turn2Me is urging regulators to ensure platforms comply with existing obligations to protect users from content that can cause psychological harm.