India has ordered Elon Musk’s X to make instant technical and procedural modifications to its AI chatbot Grok after customers and lawmakers flagged the era of “obscene” content material, together with AI-altered photographs of girls created utilizing the instrument.
On Friday, India’s IT ministry issued the order directing Musk’s X to take corrective motion on Grok, together with proscribing the era of content material involving “nudity, sexualization, sexually specific, or in any other case illegal” materials. The ministry additionally gave the social media platform 72 hours to submit an action-taken report detailing the steps it has taken to forestall the internet hosting or dissemination of content material deemed “obscene, pornographic, vulgar, indecent, sexually specific, pedophilic, or in any other case prohibited below regulation.”
The order, reviewed by TechCrunch, warned that failure to conform may jeopardize X’s “protected harbor” protections — authorized immunity from legal responsibility for user-generated content material below Indian regulation.
India’s transfer follows issues raised by customers who shared examples of Grok being prompted to change photographs of people — primarily girls — to make them look like sporting bikinis, prompting a formal criticism from Indian parliamentarian Priyanka Chaturvedi. Individually, latest reviews flagged cases wherein the AI chatbot generated sexualized photographs involving minors, a difficulty X acknowledged earlier on Friday was brought on by lapses in safeguards. These photographs have been later taken down.
Nonetheless, photographs generated utilizing Grok that made girls look like sporting bikinis via AI alteration remained accessible on X on the time of publication, TechCrunch discovered.
The most recent order comes days after the Indian IT ministry issued a broader advisory on Monday, which was additionally reviewed by TechCrunch, to social media platforms, reminding them that compliance with native legal guidelines governing obscene and sexually specific content material is a prerequisite for retaining authorized immunity from legal responsibility for user-generated materials. The advisory urged firms to strengthen inside safeguards and warned that failure to take action may invite authorized motion below India’s IT and legal legal guidelines.
“It’s reiterated that non-compliance with the above necessities shall be seen critically and will lead to strict authorized penalties towards your platform, its accountable officers and the customers on the platform who violate the regulation, with none additional discover,” the order warned.
Techcrunch occasion
San Francisco
|
October 13-15, 2026
The Indian authorities stated noncompliance may result in motion towards X below India’s IT regulation and legal statutes.
India, one of many world’s largest digital markets, has emerged as a vital check case for a way far governments are keen to go in holding platforms liable for AI-generated content material. Any tightening of enforcement within the nation may have ripple results for world expertise firms working throughout a number of jurisdictions.
The order comes as Musk’s X continues to problem elements of India’s content material regulation guidelines in courtroom, arguing that federal authorities takedown powers danger overreach, even because the platform has complied with a majority of blocking directives. On the identical time, Grok has been more and more utilized by X customers for real-time fact-checking and commentary on information occasions, making its outputs extra seen — and extra politically delicate — than these of stand-alone AI instruments.
X and xAI didn’t instantly reply to requests for touch upon the Indian authorities’s order.
