X Admits Grok Obscenity Lapses, Takes Down 600+ Accounts in India | Quick Digest

X Admits Grok Obscenity Lapses, Takes Down 600+ Accounts in India | Quick Digest
Social media platform X has admitted mistakes regarding obscene content generated by its AI, Grok, and has taken down over 600 accounts and 3,500 pieces of content following directives from the Indian government. The company has assured compliance with Indian laws to prevent such misuse.

X acknowledged lapses in content moderation on its Grok AI.

Over 600 accounts and 3,500 obscene content pieces were removed.

Indian government sources confirmed X's commitment to compliance.

The issue stemmed from Grok generating sexually explicit deepfake images.

Government warned of legal action and loss of 'safe harbour' protection.

The controversy has also drawn global scrutiny from other nations.

Social media giant X, owned by Elon Musk, has admitted its errors and acknowledged significant lapses in its content moderation standards concerning the misuse of its artificial intelligence chatbot, Grok. Following stern warnings and directives from the Indian Ministry of Electronics and Information Technology (MeitY), X has taken down over 600 accounts and blocked approximately 3,500 pieces of obscene and sexually explicit content. The 'Grok obscenity row' erupted after users reportedly exploited Grok's image generation features, including a 'spicy mode,' to create and disseminate non-consensual deepfake images, particularly targeting women and children in a derogatory and vulgar manner. The Indian government, citing statutory due diligence obligations under the Information Technology Act, 2000, and IT Rules, issued a notice to X, demanding immediate removal of such content and a comprehensive review of Grok's technical and governance frameworks. Government sources indicated that X has assured full compliance with Indian laws and pledged to prevent the generation and hosting of obscene imagery moving forward. MeitY had cautioned X that non-compliance could lead to severe legal consequences, including the loss of 'safe harbour' protection under Section 79 of the IT Act, making the platform liable for penal action. This incident highlights growing global concerns over AI-generated deepfakes and the accountability of platforms, with countries like Indonesia also blocking access to Grok and regulators in the UK, EU, France, Malaysia, and Brazil initiating inquiries. The story underscores the ongoing challenge of balancing free speech, AI innovation, and user safety in the digital age.
Read the full story on Quick Digest