A new law has been introduced this week to criminalize the creation of non-consensual intimate images, following a surge in sexually explicit deepfake content on the social media platform owned by Elon Musk. Technology Secretary Liz Kendall labeled the AI-generated images by X’s chatbot Grok as tools of abuse, prompting Ofcom to launch an official investigation into the platform.
During a parliamentary address, Kendall announced the imminent enforcement of legislation prohibiting the production or distribution of non-consensual intimate images. Additionally, she stated that applications enabling the creation of fake nude images will be outlawed under the Crime and Policing Bill currently progressing through Parliament. This legislation aims to tackle the issue at its root by making it illegal for companies to provide tools designed for generating non-consensual content.
Meanwhile, Ofcom’s inquiry is focused on determining whether X, formerly known as Twitter, has failed to meet its legal obligations under the Online Safety Act. Potential penalties for non-compliance include fines of up to £18 million or 10% of global revenue, as well as the imposition of business disruption measures. Kendall emphasized the harmful impact of such content, highlighting that it disproportionately affects women and girls and constitutes illegal behavior.
In response to concerns raised about X’s AI tool Grok, Ofcom has urgently engaged with Musk’s platform and xAI. The regulator expressed worries over the creation of sexualized images, including those of children, through Grok. The Internet Watch Foundation has identified instances of child sexual abuse material allegedly produced using Grok, prompting swift action from the authorities.
Acknowledging the gravity of the situation, Musk’s company has pledged to address the lapses in safeguards related to child sexual abuse material. In a recent statement, Musk reiterated a zero-tolerance policy towards illegal content and announced plans to introduce a paid service for creating deepfakes using Grok. This move has sparked criticism from officials and activists, who view it as an attempt to profit from abusive content.
The government remains vigilant, with Labour Party leader Keir Starmer condemning the platform for prioritizing abusive users over victims. Swift and resolute action is expected from both regulatory bodies and the platform itself to combat the dissemination of harmful content.