Lawsuit against xAI: Content produced by Grok drew reaction

Three young people in the US state of Tennessee filed a remarkable lawsuit against Elon Musk’s artificial intelligence company xAI. In the lawsuit, it is claimed that the artificial intelligence chat bot called Grok, developed by the company, produces sexual images and videos featuring underage individuals. According to information reported by the Washington Post, the class action lawsuit filed on Monday alleges that Grok’s “spicy mode” feature, which was introduced last year, was activated without adequate security measures. Accordingly, it is argued that xAI administrators are in a position to foresee that the feature in question could be abused.

The plaintiffs include two minors and an adult who was not a minor at the time of the incidents. One of the victims, whose identity is kept secret, states that he noticed that inappropriate images of himself created by artificial intelligence were circulating on the Discord platform in December. According to the case file, some of these contents, while containing the real facial and body features of the victim, were turned into scenes of sexual content by making it seem like they were shot in familiar environments. In addition, it is stated that at least 18 different minors were targeted in a similar way.

xAI and Grok at the center of security debate

It is stated that the suspect in the incident in question has been arrested. Allegedly, the person in question used the content he created as a means of exchange in groups on Telegram and shared it with hundreds of users. While it is claimed that these contents are produced through Grok, it is argued that the system developed by xAI has not passed sufficient security tests and is flawed in terms of design. Despite this, it is claimed that the company ignored these risks.

It is known that Grok has come up with similar content on the X platform before. The rapid spread of indecent images of adults and minors has sparked serious backlash across the United States. In addition, calls were made to the US Federal Trade Commission (FTC) for an investigation, while European Union institutions also launched an investigation on the issue. British Prime Minister Keir Starmer also warned about the issue, showing that the issue has gained an international dimension.

On the other hand, the new law adopted by the US Senate in January gives victims of deepfake content created without permission the right to take legal action. In addition, the Take It Down Act, which came into force in 2025 and will be implemented in May, criminalizes the distribution of unauthorized content produced by artificial intelligence. Despite all this, platforms still seem to have difficulty blocking such content completely.

The X front, on the other hand, states that Grok has introduced some restrictions to prevent its abuse. Despite this, tests reveal that images uploaded to the platform can still be manipulated. Although the company states that users who produce illegal content will face legal consequences, the adequacy of existing measures remains a matter of debate.

Annika K. Martin, one of the plaintiffs’ lawyers, drew attention to the seriousness of the incident and emphasized that it is unacceptable to turn innocent photographs of children into abusive content. The lawsuit seeks compensation for the victims, while also requiring xAI to take steps to prevent the production and dissemination of such content.