Key Highlights
- UK regulator Ofcom has started a formal investigation into Elon Musk-owned X over concerns linked to Grok AI-generated sexual deepfakes.
- Senior ministers, including the UK’s PM Keir Starmer, have urged swift action, calling the images “disgusting” and potentially unlawful.
- Ofcom will assess whether X breached its legal duty to prevent UK users from encountering illegal content.
Britain’s media regulator Ofcom has launched a formal investigation into Elon Musk-owned social media platform X to determine whether its AI chatbot Grok has been used to generate and circulate illegal sexual deepfake images. The probe will assess whether X (formerly Twitter) failed to meet its obligations under UK law to protect users from harmful and unlawful content.
Ofcom Launches Investigation Into X Over Grok AI’s Deepfake Images
In a statement issued on Monday, Ofcom said it had received ‘deeply concerning reports’ suggesting that Grok was being used to create undressed images of people without consent, as well as sexualised images of children. The UK regulator said such content could amount to non-consensual intimate image abuse or child sexual abuse material, both of which are illegal in the UK.
This investigation will be one of the first of its kind to test whether AI tools built into social media platforms comply with the UK’s online safety laws.
Regulator Flags Risks of Illegal and Child Sexual Content
Ofcom stated that it would investigate whether X properly assessed the risks posed by Grok’s image-generation feature and whether the company responded quickly enough to remove illegal content.
The watchdog is under growing political pressure as the UK’s Prime Minister Keir Starmer described images generated using Grok as ‘disgusting’ and ‘unlawful’ last week. He further stated that X needed to ‘get a grip’ on the tool, as concerns mounted over the spread of AI-generated sexual imagery.
Additionally, Business Secretary Peter Kyle also stated on Monday that banning X in the UK was ‘of course’ an option, although he emphasized that the authority to take such action rests with Ofcom.
You may also like: AI boom reportedly made tech billionaires like Elon Musk even richer in 2025
X Responds, Says It Takes Action Against Illegal Content
Responding to the investigation, X stated that it takes action against illegal content on the platform, including any child sexual abuse material. The company said in such instances, the content is removed, and accounts are permanently suspended, as reported by Reuters.
The platform added that users who prompt Grok to generate illegal content face the same consequences as those who upload such material directly. X has also said it restricts requests to undress people in images to paying users.
Although Elon Musk has criticised the UK government’s response, suggesting it was seeking “any excuse for censorship” after questions were raised about why other AI platforms were not facing similar scrutiny.
What UK Law Says on AI-Generated Sexual Images
Under British law, creating or sharing non-consensual intimate images is illegal, regardless of whether the content is AI-generated. The same applies to child sexual abuse material, including digitally created sexual imagery involving minors.
Technology platforms are required not only to remove illegal content once identified, but also to take proactive steps to prevent users in the UK from encountering it. Ofcom said it would examine whether X used ‘highly effective’ measures, including age assurance systems, to limit access to pornographic content.
If X is found to have breached its duties, Ofcom has the authority to impose fines of up to 10% of the company’s global annual revenue or £18 million, whichever is higher. In extreme cases, the regulator can also seek court orders to restrict access to the platform in the UK.
What Happens Next in Ofcom’s Probe
Ofcom said the investigation would be treated as a matter of ‘highest priority’ but did not provide a timeline for its conclusion. The regulator added that it would not hesitate to act where there is a risk of serious harm, particularly to children.
The probe comes as the scrutiny of Grok’s image-generation tool intensifies globally. French authorities have reported X to prosecutors and regulators, calling similar content “manifestly illegal”. Similarly, Malaysia and Indonesia have temporarily blocked access to the feature.
The outcome of Ofcom’s investigation could set an important precedent for how AI-generated content is policed on social media platforms in the UK, particularly as generative AI tools become more widely integrated into products designed for the general public.
