UK Regulator Launches Formal Probe into X Over Disturbing Deepfake Concerns
The UK government is turning up the heat on Elon Musk’s social media platform, X, as the country’s independent media and online safety regulator, Ofcom, has officially launched a formal investigation. The probe follows what regulators have called “deeply concerning reports” that the platform’s integrated conversational feature, Grok, was being exploited to generate and share highly illegal, non-consensual intimate images.
The heart of the matter lies with a disturbing new trend of what are known as “deepfakes,” specifically the creation of sexually explicit, digitally manipulated photos of individuals without their consent. Reports have indicated that the tool has been used to generate sexualized images of women and even material that may constitute child sexual abuse material (CSAM).
Ofcom’s investigation will assess whether X is in breach of its key obligations under the UK’s landmark Online Safety Act. This legislation places a legal duty on tech companies to proactively identify and remove illegal content, especially material that harms children, as well as to conduct proper risk assessments when making significant changes to their service. The regulator had previously contacted X for an urgent explanation of its protective measures, but following an expedited review of the company’s response, it decided to escalate the matter to a full investigation.
Government Condemnation and Potential Penalties
The government’s response has been swift and severe. Technology Secretary Liz Kendall called the images “vile” and “weapons of abuse” and welcomed Ofcom’s prompt action. She further announced that the government is bringing into force a new criminal offense targeting the creation of non-consensual intimate images, underscoring the severity of the content circulating on the platform. Meanwhile, UK Prime Minister Keir Starmer has publicly described the content as “disgraceful” and “disgusting,” stating that such material will “not be tolerated”.
The stakes are incredibly high for the social media giant. If X is found to be in violation of the Online Safety Act, Ofcom has the power to impose hefty financial penalties, which could amount to fines of up to 10% of the company’s worldwide revenue. In the most serious scenarios, the regulator could even seek a court order to block UK users from accessing the service altogether.
Company’s Actions Draw Criticism
In response to the backlash, the platform acknowledged weaknesses in its safety measures and made changes, including restricting the problematic image creation feature to only its paying subscribers.
However, this move drew sharp criticism from officials. A spokesperson for the Prime Minister’s office dismissed it as insufficient, saying it was “not a solution” and instead amounted to “monetising abuse”. For his part, X owner Elon Musk has pushed back against regulatory pressure, rejecting accusations of non-compliance and describing potential restrictions on the feature as a form of “censorship and suppression of free speech”.
The UK’s formal probe places the country alongside a growing international effort to hold the platform accountable, with regulators in the European Union, Australia, India, and other countries also taking action or expressing severe concerns over the tool’s capabilities.