India’s IT ministry seeks review of X Grok chatbot over alleged misuse involving women’s images

India’s Ministry of Electronics and Information Technology on Friday directed social media platform X to conduct a comprehensive technical, procedural and governance level review of its Grok chatbot, following allegations of misuse related to women’s images.

The move followed a letter by Shiv Sena UBT Rajya Sabha MP Priyanka Chaturvedi to IT Minister Ashwini Vaishnaw, raising concerns that Grok had responded to user prompts seeking to undress or alter clothing in photos of women.

X did not issue an immediate response. Grok operates as a separate artificial intelligence entity under X’s holding structure but interacts with users through the platform. X owner Elon Musk has previously described Grok as having fewer safeguards compared to other AI systems.

In a letter to X’s Chief Compliance Officer in India, the Ministry said it had observed misuse of the chatbot to generate and circulate obscene or derogatory content involving women. It stated that compliance with India’s Information Technology Act and the IT Rules of 2021 is mandatory, and that legal protections apply only when due diligence obligations are met.

The Ministry instructed X to remove or disable access to such content without delay, while preserving evidence as required by law. The company has been asked to submit an Action Taken Report by January 5.

It warned that failure to comply could lead to legal action under applicable technology and criminal laws.

Earlier, Mr Vaishnaw said social media platforms must take responsibility for content hosted on their services. Authorities also issued an advisory earlier this week directing platforms to proactively remove obscene and pornographic material.