Musk’s Grok AI banned in Malaysia and Indonesia over Deepfake Abuse

Malaysia and Indonesia have temporarily blocked access to Grok, the artificial‑intelligence chatbot built by Elon Musk’s xAI and embedded in the X social media platform, following reports that the tool generated non‑consensual sexualised images of women and children.

The Malaysian Communications and Multimedia Commission (MCMC) said on 12 January 2026 that repeated misuse of the tool to produce obscene and non‑consensual images left it with no option but to restrict access until effective technical and moderation safeguards are in place as first reported by Reuters.

Indonesia’s Ministry of Communications and Digital Affairs had blocked the service two days earlier, becoming the first country to deny access to the AI tool after warning that non‑consensual deepfakes violate human rights and digital safety.

Core facts

• Regulators act after repeated misuse.  MCMC said it issued notices to X and xAI earlier in January demanding safeguards to prevent misuse, but the responses relied mainly on user‑initiated reporting and failed to address risks posed by Grok’s design. The regulator added that access would remain blocked until effective measures are implemented.

  
  

• Indonesia cites human rights violations.  Indonesian communications minister Meutya Hafid said the government views non‑consensual sexual deepfakes as “a serious violation of human rights, dignity, and the security of citizens in the digital space”. The ministry summoned X officials to discuss the matter.

  
  

• Developer limits features.  On 9 January 2026, xAI restricted image generation and editing features of Grok to paying subscribers after global backlash, though the standalone app and tab on X continued to allow image generation. The company said this would identify users who misuse the feature; the European Commission said the change did not address its concerns about unlawful images

  
  

• Official responses in the UK.  Britain’s media regulator Ofcom launched an investigation into X to determine whether Grok’s sexualised images breached UK law. Prime Minister Keir Starmer called the images “disgusting” and “unlawful” and urged X to “get a grip”. Business Secretary Peter Kyle said the government would support Ofcom if it sought a court order to block X in Britain. Technology Secretary Liz Kendall said the Online Safety Act gives Ofcom the power to block services that refuse to comply and pledged full support if those powers are used.

Additional context

Grok is an AI chatbot developed by xAI, an Elon Musk‑led company, and is accessible through X as well as a standalone app. The tool can generate text and images in response to user prompts. In early January 2026, social media users began sharing examples of the tool producing altered images of women and minors, prompting condemnation from governments and regulators worldwide. The European Commission, French regulators and Indian authorities have described the images as unlawful and urged swift action.

Non‑consensual intimate images and child sexual abuse material are illegal in both Malaysia and Indonesia, which have previously taken tough stances on online pornography. Malaysia’s decision follows Indonesia’s block and makes it one of the first countries to restrict access to Grok. The actions highlight growing regulatory scrutiny of generative AI tools and underscore concerns that such technology can facilitate harassment and abuse if left unchecked.

Background

Grok forms part of a wave of generative AI tools that can create realistic images and text from user prompts. While such tools have potential for productivity and entertainment, they also raise new issues about safety and legality. Authorities in Malaysia and Indonesia emphasised that the bans are temporary and could be lifted once robust safeguards against abuse are in place. Observers say the swift actions by the South‑East Asian nations may set a precedent for other jurisdictions grappling with AI‑generated deepfakes and online safety.

Source: Reuters.