Regulators target X over Grok-generated explicit imagery

The social media platform X is facing a wave of regulatory pressure following reports that its Grok AI chatbot has been used to generate a flood of AI-manipulated nude images and non-consensual nudes. According to a research paper published on December 31 by research firm Copyleaks, roughly one image was being posted each minute. However, subsequent testing showed a much higher volume; a sample gathered from January 5-6 found 6,700 images per hour over a 24-hour period.

Regulators in multiple jurisdictions are moving quickly to address the platform’s safety practices. On Thursday, the European Commission ordered xAI, the developer of the Grok chatbot, to retain all documents related to the tool. Meanwhile, MeitY (India’s communications regulator) ordered X to address the issue and submit an action-taken report. MeitY initially set a 72-hour deadline, which was subsequently extended by 48 hours; X submitted a report to the regulator on January 7. In the United Kingdom, Ofcom (the UK communications regulator) issued a statement on Monday, saying it was in touch with xAI and would conduct a swift assessment to determine whether potential compliance issues warrant an investigation. Additionally, Julie Inman-Grant, the Australian eSafety Commissioner (an Australian government official), stated that her office has received a doubling in complaints related to Grok since late 2025. Inman-Grant warned, “We will use the range of regulatory tools at our disposal to investigate and take appropriate action.”

The platform has publicly responded to the backlash. On January 3, the X Safety account posted a statement denouncing the use of AI tools to produce child sexual imagery, asserting that users prompting Grok to create illegal content would face the same consequences as those who upload it. However, internal decisions at xAI have also drawn scrutiny. CNN reported that Elon Musk, the CEO of X and xAI, may have personally intervened to prevent safeguards from being placed on Grok. The situation has drawn high-level political condemnation, particularly in the United Kingdom. On Thursday, UK Prime Minister Keir Starmer called the phenomenon disgraceful and disgusting in a radio interview, signaling that Ofcom has the government’s full support to take action.

Why it matters

The rapid proliferation of AI-generated non-consensual imagery on X has triggered a wave of regulatory scrutiny, highlighting the limitations of current tech oversight mechanisms. Regulators in the European Commission, United Kingdom, Australia, and India are now actively challenging the platform’s safety safeguards and data practices.