Dutch Court Bans xAI's Grok from Nonconsensual Images

A Dutch court issued a preliminary injunction on Thursday ordering Elon Musk's xAI and its Grok chatbot to cease generating and distributing nonconsensual sexualized images of adults or children in the Netherlands, imposing potential fines of 100,000 euros per day for noncompliance. The ruling from the Amsterdam District Court prohibits the AI tool and the X platform, which hosts it, from creating or sharing imagery that depicts individuals partially or fully undressed or in sexualized poses without their explicit permission. The court also barred xAI from offering Grok on X while violating the order.

The decision stemmed from a civil lawsuit filed by Offlimits, a Dutch nonprofit focused on combating online sexual abuse, in partnership with the Victims Support Fund. The groups argued that Grok's image-generation features enable users to produce hyperrealistic deepfakes, including nonconsensual nudes of real people and children, posing significant risks to privacy and safety. During a March hearing, plaintiffs demonstrated Grok's capabilities by generating a video of a nude person shortly before the proceedings, casting doubt on the effectiveness of xAI's safeguards.