The online network X has provoked significant outrage after users utilized its AI chatbot Grok to alter photos of females by removing their attire.
Numerous examples have surfaced where the system has been used to virtually strip female subjects to show them in bikinis without consent, as well as to put them in sexually explicit scenarios.
Developer Reaction and Legal Position
XAI, the organization responsible for Grok, remained silent to inquiries, aside from an standard response stating "legacy media lies".
A government official stated that new laws is being introduced to outlaw nudification software. Under a new criminal offence, anyone who provided such technology would "receive a jail term and significant penalties".
"The platform has the ability to stop these types of misuse if they wanted to," said a law professor, adding they "operate with impunity."
Oversight Body Stance and Tool Capabilities
The regulator Ofcom said tech firms must "assess the risk" of people accessing unlawful material on their platforms, but did not confirm whether it was presently looking into X or Grok in relation to artificial intelligence pictures.
Grok is a free chatbot—with some premium functions—which reacts to X users' requests when they mention it in a message.
It is frequently used to provide commentary or additional context to other posters' remarks, but people on X are also can alter an uploaded image through its AI image editing feature.
Background of Controversy and Policy
The system has been faulted for enabling users to produce images and videos with explicit content and sexualised content, and it was in the past alleged to have been involved in creating inappropriate content of celebrities.
"X has been enabling the generation and spread of these pictures for months without taking any measures and we have yet to see any challenge by regulators," the expert added.
XAI's own acceptable use policy forbids "depicting images of persons in a graphic way".
In a statement, Ofcom said it was illegal to "generate or share deepfakes or child sexual abuse material" and stated this included explicit AI images generated with AI.
It said services such as X were required to take "suitable actions" to "reduce the risk" of users viewing unlawful material on their platforms and to take down it promptly when they learn of it.
