Elon Musk’s artificial intelligence company, xAI, has filed a lawsuit against a South Carolina man accused of using its Grok chatbot to generate child sexual abuse material and non-consensual explicit deepfakes.
The lawsuit, filed on Tuesday in a federal court in Texas, alleges that Terry Harwood breached xAI’s terms of service by exploiting the AI platform to create illegal and sexually explicit content. The case is believed to be among the first instances of an AI company taking legal action against one of its own users over the alleged misuse of generative AI technology.
Harwood was arrested in February on charges related to the sexual exploitation of minors. His legal representation was not immediately known, and xAI did not issue additional comments beyond the court filing.
According to the complaint, Harwood uploaded ordinary images of both adults and minors into Grok and attempted to transform them into sexually explicit AI-generated images. The lawsuit further alleges that he also created non-consensual sexualized images involving adults.
xAI said the company actively enforces its safety policies through account suspensions, permanent bans and by reporting suspected child sexual abuse material to the National Center for Missing & Exploited Children (NCMEC).
The lawsuit states that “Plaintiff has suspended 52,222 accounts and made 73,604 reports to NCMEC in 2026, resulting in (at least) 244 arrests.”
The legal action comes as xAI continues to face international scrutiny over concerns that Grok has, at times, been used to generate non-consensual sexualized deepfakes—AI-generated images or videos designed to closely resemble real people without their consent.
As part of the lawsuit, xAI is seeking unspecified monetary damages and a permanent court order preventing Harwood from accessing or using Grok in the future.
In its filing, the company argued that “Defendant’s actions were a calculated scheme to weaponize Plaintiff’s tool for criminal ends, exposing real victims to profound and lasting harm, while exposing Plaintiff to significant legal risk and reputational damage.”
The lawsuit marks a significant development in the growing effort by AI companies to hold users accountable for the alleged misuse of generative artificial intelligence tools, particularly in cases involving child exploitation and non-consensual explicit content.
Source: Reuters
