xAI has been accused of training its Grok models on child sexual abuse material (CSAM), according to a lawsuit filed by a plaintiff identified as Jane Doe.
What Happened
In the complaint filed on Wednesday, Doe alleges she was preschool-age in the early 2000s when adult men repeatedly raped her to create CSAM that was sold online. Her images have been hashed by organizations including the National Center for Missing and Exploited Children (NCMEC) and the Canadian Centre for Child Protection (CCCP). The CCCP later notified Doe that it had identified AI-generated CSAM depicting her on xAI's platform, a discovery she says re-traumatized her. Investigators also found messages on online forums between offenders discussing creation of AI-generated CSAM of Doe and other known legacy victims.
Why It Matters
The lawsuit raises serious questions about data sourcing practices in AI training and the potential for generative models to produce illegal content depicting minors. Regulators and courts are continuing to probe how widespread the problem may be, according to the report. Some Grok users have already been arrested in connection with such activity.
The Bottom Line
xAI faces allegations that its Grok models were trained on CSAM, adding the company to a growing list of AI developers under scrutiny for training data practices.