Indonesia has made headlines as the first country to block Elon Musk’s Grok chatbot due to concerns surrounding the generation of deepfake images, particularly non-consensual sexual content. The communication and digital affairs minister, Meutya Hafid, emphasized on Saturday that the manipulation of AI technology to create fake, pornographic materials constitutes a serious violation of human rights, as well as a threat to the dignity and security of citizens in the digital environment.

Hafid stated, “In order to protect women, children, and the public from the risks of fake pornographic content generated using artificial intelligence technology, the government has temporarily blocked access to the Grok application.” This decision underscores Indonesia’s commitment to combatting the potentially detrimental impact of deepfake technology.

This move followed Grok’s recent restriction on image generation and editing features on Musk’s social media platform X, which was adjustment made for paying subscribers in response to escalating concerns surrounding deepfakes. Musk has acknowledged the responsibility of users, asserting that anyone employing Grok to create illegal content would face consequences comparable to those faced by individuals directly involved with such material.

Despite these measures, the decision to limit the AI tool’s capabilities has faced backlash from European officials and tech advocates who argue that it inadequately addresses significant concerns. The British Prime Minister’s office condemned the restriction, describing it as “insulting” to victims of deepfake abuse. A spokesperson articulated, “That simply turns an AI feature that allows the creation of unlawful images into a premium service. It’s insulting to victims of misogyny and sexual violence,” displaying the dissatisfaction towards the proposed solution.

In light of these developments, the Indonesian culture and digital affairs ministry has reportedly summoned officials from X for discussions regarding the responsible governance of AI technologies, reflecting the increasing scrutiny and regulatory challenges faced by such platforms amidst societal concerns.