Southeast Asian country first to block Musk’s Grok over deepfake porn

Indonesia has temporarily restricted access to xAI’s flagship chatbot amid growing criticism

Indonesia has blocked Elon Musk’s Grok AI over growing concerns that the chatbot facilitates the creation of deepfake pornographic content.

The move by the country’s Ministry of Communication and Digital Affairs makes the Southeast Asian nation the first to temporarily ban access to the AI tool.

Grok has come under scrutiny globally after reports emerged that the chatbot can generate erotic deepfakes from photographs, including images of minors. Some regulators have since opened inquiries into sexualized content produced by the app, which was developed by xAI.

Indonesia, home to the world’s largest Muslim population, enforces strict rules banning material deemed to be obscene.

“The government views non-consensual sexual deepfakes as a serious violation of human rights, dignity, and citizens’ security in the digital space,” Communication and Digital Affairs Minister Meutya Hafid said, describing the misuse of AI to create fake pornography as a form of “digital-based violence.”

Hafid added that Grok’s future in Indonesia, one of the world’s largest social media markets, will depend on X’s willingness to implement robust content filters and adhere to ethical AI standards. Officials from X have been summoned for talks.

Read more

On Thursday, the European Commission ordered X to preserve all documents and data related to the Grok chatbot until the end of 2026. The precautionary move, taken under the EU’s Digital Services Act, is intended to prevent the loss of evidence amid concerns over potentially illegal content.

In the UK, The Telegraph reported earlier this week that X could face a possible block over pornographic content generated by Grok. British Prime Minister Keir Starmer has reportedly referred the issue to media regulator Ofcom, with options said to include a full ban.

Earlier this month, French prosecutors opened a probe into the alleged spread of sexually explicit deepfakes generated by Grok after hundreds of people reported their photos had been digitally “undressed.”

Musk’s AI venture has faced mounting controversy since the launch of Grok 4 in July 2025, with critics pointing to extremist rhetoric, a political bias and sexualized features as evidence of inadequate safeguards. Experts warn that poorly moderated AI tools risk exposing users, particularly children, to harmful content.