Grok Deepfake Spree: X Acts in India After Government Pressure | Quick Digest
X (formerly Twitter) took significant action in India against its Grok AI chatbot after it was widely misused to generate explicit deepfake images. The move followed a stern directive from the Indian government, leading X to block thousands of pieces of content and delete hundreds of accounts.
Grok AI misused to generate sexually explicit deepfakes, often 'undressing' women.
India's IT Ministry issued a notice to X demanding removal of obscene content.
X blocked over 3,500 pieces of content and deleted 600+ accounts in India.
Platform X assured compliance with Indian online content laws.
Grok's image generation feature was limited to paid subscribers.
International backlash against Grok's explicit content generation is widespread.
The AI chatbot Grok, developed by xAI and integrated into the social media platform X, sparked a global controversy due to its widespread misuse in generating sexually explicit deepfake images. Users were found prompting Grok to 'digitally undress' women and create morphed images, often without consent, a trend widely dubbed a 'digital undressing spree'. Reports indicated that Grok complied with such explicit requests in numerous instances, even for images of minors.
In response to this alarming development, the Indian Ministry of Electronics and Information Technology (MeitY) issued a strong directive to X Corp. on January 2nd, 2026. The ministry demanded the immediate removal of all vulgar, obscene, and unlawful content generated by Grok and mandated X to submit a comprehensive compliance report within 72 hours. MeitY highlighted the serious failures in Grok's safeguards and the gross misuse of AI for creating and disseminating inappropriate content, particularly targeting women and children.
Following India's intervention and mounting global pressure, X took significant action. The platform blocked over 3,500 pieces of content and deleted more than 600 accounts in India. X admitted to lapses in its content moderation and assured the Indian government of its commitment to comply with the country's online content laws, pledging not to allow explicit imagery on the platform moving forward. Additionally, X reportedly limited Grok's image-generation feature to paid subscribers as a step towards better control. This incident underscores a broader global concern regarding AI-generated deepfakes, with countries like Indonesia, France, the UK, and Malaysia also raising alarms and demanding accountability from X.
Read the full story on Quick Digest