Grok AI Banned from Creating Sexualised Images

Elon Musk’s platform X announced that its AI chatbot Grok can no longer generate sexualised images of real people, following international backlash over explicit photos of women and children.

California Attorney General Rob Bonta is investigating xAI, Grok’s developer, over non-consensual sexual content. Several countries, including Indonesia and Malaysia, blocked access to the chatbot, while India saw X remove thousands of posts and hundreds of accounts. Britain’s Ofcom has also opened a probe.

X said it will geoblock users from creating images of people in “bikinis, underwear, and similar attire” where such content is illegal.

“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety team said.
“This restriction applies to all users, including paid subscribers.”

Image creation and editing is now limited to paid subscribers as an extra layer of protection.

The crackdown comes after Grok’s “Spicy Mode” allowed sexualised deepfakes through simple prompts like “put her in a bikini” or “remove her clothes.”

“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking,” Bonta said.
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.”

The European Commission welcomed X’s measures, pledging to assess whether they effectively protect EU citizens. An analysis by AI Forensics of over 20,000 Grok images found that over half depicted “individuals in minimal attire,” most women, with two per cent appearing to be minors.