A single childhood photograph allegedly became the source of more than 7,000 explicit AI-generated images, according to a new lawsuit involving xAI’s Grok.
The allegation, reported by The Washington Post, has added another case to a growing legal and regulatory challenge over whether generative AI companies can prevent their image tools from being used to sexualise real people, particularly children.
The woman, identified in court documents as Jane Doe 4, alleges that her stepfather used Grok to manipulate a photograph taken when she was 11. She says the tool was used to create more than 7,000 explicit images. These are allegations and have not been established by a court.
Lawsuit Expands Existing Case
Jane Doe 4 has joined a federal lawsuit originally filed by three Tennessee plaintiffs against xAI. Reuters reported in March that the plaintiffs included two minors and alleged that Grok had been used to turn real photographs of them into sexually explicit images.
The lawsuit seeks class-action status for people in the US who were reasonably identifiable in sexualised images or videos generated by Grok from real photographs. The plaintiffs allege that xAI failed to install adequate safeguards to prevent the creation of sexual content involving minors.
xAI had not immediately responded to Reuters’ request for comment at the time of that report. TechCrunch separately said it contacted xAI for comment regarding the new allegations.
The significance of the latest case is that it focuses attention on a particularly difficult safety problem: the ability to take an ordinary photograph and use generative AI to produce harmful synthetic material at scale.
Regulators Already Raised Concerns
The legal claims come after regulators in several countries examined Grok’s handling of sexualised imagery.
In June, Canada’s Privacy Commissioner concluded that X Corp. and xAI violated Canada’s federal private-sector privacy law. The investigation found that Grok’s image-generation tool had been launched without proper safeguards or sufficient consideration of potential privacy harms.
The regulator said users around the world had been able to create and share non-consensual sexualised deepfakes, including images targeting women and children. It said X and xAI introduced additional safeguards and proactive detection measures after the issue became public, but recommended further action and evidence demonstrating that those safeguards were effective.
Australia’s eSafety Commissioner had raised concerns months earlier. In January, it said reports concerning Grok-generated sexualised or exploitative imagery had risen from almost none to several over a period of weeks. The regulator specifically highlighted potential child sexual exploitation material and sought information from X about safeguards.
The UK’s Information Commissioner’s Office also opened a formal investigation in February into xAI and X’s EU data controller, citing concerns over personal-data processing and the generation of harmful sexualised content.
xAI’s Safety Rules
xAI’s current policies prohibit the very categories at the centre of the controversy. Its Grok FAQ says child sexual abuse material, sexual content involving minors and non-consensual intimate imagery are prohibited regardless of settings or subscriptions.
Its May 2026 policy also prohibits the publication, sharing or distribution of non-consensual intimate imagery, including synthetically generated material involving identifiable people. xAI says valid removal requests are handled as soon as possible and no later than 48 hours.
Those rules, however, are different from demonstrating that safeguards consistently prevent prohibited material from being generated or distributed.
That distinction is now central to the scrutiny facing xAI. The Canadian regulator’s findings show that safeguards are being evaluated not only through company policies but also through their effectiveness in practice.
AI Safety Faces Bigger Test
The Grok cases highlight a broader challenge for the generative AI industry. As image-generation systems become more capable, preventing misuse increasingly requires more than refusing obviously harmful prompts. Companies must also address how users combine real photographs, image editing and repeated generation to create abusive material.
For xAI, the latest lawsuit adds to legal and regulatory scrutiny that now spans the US, Canada, Australia and the UK. For the wider AI industry, the cases raise a more fundamental question: whether companies will be judged primarily by the safety rules they publish or by how effectively those rules protect people when the technology is used in the real world.
Also Read: Grok Under Fire: Why Mounting Lawsuits Against AI Giants Are Triggering a Global Trust Crisis?
