The Grok controversy erupted when users exploited simple prompts to generate and share explicit, non-consensual images of women, leading to widespread outrage in India. MeitY responded swiftly with a notice to X, citing violations of IT Rules on due diligence and content moderation.
The directive requires deletion of all offending posts, technical review of Grok to prevent unlawful prompts, account suspensions, and strict enforcement. Complaints highlighted how such tools normalise harassment and violate privacy.
Priyanka Chaturvedi and activists praised the quick action. Elon Musk clarified user liability for illegal content, aligning with laws but intensifying platform responsibility debate.
X promised improved filters and reporting. The case underscores challenges in regulating generative AI amid India's vast digital population.
As compliance deadline approaches, it sets a strong precedent for holding tech giants accountable while protecting users from AI-enabled harm, especially women facing online abuse.
TL;DR
- MeitY issues strict notice to X on January 2, 2026, over Grok AI being misused to generate obscene and sexually explicit content targeting women without consent.
- 72-hour ultimatum demands immediate removal of all unlawful AI-generated images/videos and measures to prevent future creation on the platform.
- Non-compliance threatens revocation of intermediary safe harbour protection, exposing X to legal liabilities under Indian laws.
- Viral complaints expose easy exploitation of Grok prompts for creating derogatory deepfakes violating privacy and dignity of individuals.
- Shiv Sena MP Priyanka Chaturvedi thanks IT Minister Ashwini Vaishnaw for rapid response to her flagged letter on the issue.
- X required to review Grok's technical and governance frameworks, enforce terms of service, suspend offending accounts promptly.
- Violations fall under IT Act, BNS, POCSO, and Indecent Representation of Women Act, attracting heavy penalties.
- Elon Musk responds stating users creating illegal content bear responsibility, not the platform itself in such cases.
- Incident fuels broader national debate on balancing AI innovation with ethical safeguards and effective content moderation.
- Case establishes regulatory precedent for swift action against emerging generative AI misuse risks in India.