Grok under fire over generating sexualized images of women, minors
Warning: This article includes mention of sexual abuse.
Elon Musk's Grok on Friday said it was scrambling to fix flaws in the artificial intelligence tool after users claimed it turned pictures of children or women into erotic images.
"We've identified lapses in safeguards and are urgently fixing them," Grok said in a post on X.
"CSAM (Child Sexual Abuse Material) is illegal and prohibited."
Complaints of abuses began hitting X after an "edit image" button was rolled out on Grok in late December.
The button allows users to modify any image on the platform—with some users deciding to partially or completely remove clothing from women or children in pictures, according to complaints.
Grok maker xAI, run by Musk, replied to an AFP query with a terse, automated response that said: "the mainstream media lies."
The Grok chatbot, however, did respond to an X user who queried it on the matter, after they said that a company in the United States could face criminal prosecution for knowingly facilitating or failing to prevent the creation or sharing of child porn.
Media outlets in India reported on Friday that government officials there are demanding X quickly provide them details of measures the company is taking to remove "obscene, nude, indecent, and sexually suggestive content" generated by Grok without the consent of those in such pictures.
The public prosecutor's office in Paris, meanwhile, expanded an investigation into X to include new accusations that Grok was being used for generating and disseminating child pornography.
The initial investigation against X was opened in July following reports that the social network's algorithm was being manipulated for the purpose of foreign interference.
Grok has been criticized in recent months for generating multiple controversial statements, from the war in Gaza and the India-Pakistan conflict to antisemitic remarks and spreading misinformation about a deadly shooting in Australia.
If you or someone you know is experiencing abuse, help is available.
- Bantay Bata Helpline 163: Free and confidential support over the phone. Lines open every day, 7 a.m. to 7 p.m.
- NCMH Crisis Hotline: Free, compassionate, and confidential support over the phone. Lines open 24/7. Tel:1800-1888-1553
- Philippine National Police (PNP) Hotline: 911 | Aling Pulis Text Hotline: 0919-7777-377 / 0966-7255-961 / 0920-9071-717
- Council for the Welfare of Children (CWC) Makabata Helpline: 0915-8022-375 / 0960-3779-863