Grok Restricts AI Image Generation Globally Amid Sexual Content Backlash | Quick Digest
Elon Musk's AI chatbot, Grok, has restricted its image generation features to paid subscribers on X following widespread global backlash over its use to create non-consensual sexualized images, including of minors. This move comes amid increasing pressure and regulatory actions from governments worldwide, including a temporary block in Indonesia and warnings from India.
Grok limited AI image generation to paying X subscribers after sexualized content outcry.
Global backlash intensified over non-consensual sexual deepfakes and child sexual abuse material (CSAM).
Indonesia temporarily blocked Grok, becoming the first country to deny access.
US Senators urged Apple and Google to remove X and Grok from app stores.
Indian IT Ministry warned X of legal action over obscene content from Grok.
Critics argue paywalling the feature is insufficient for content moderation.
UK officials also threatened potential ban on X over AI-generated harmful content.
Elon Musk's xAI has implemented restrictions on Grok's AI image generation and editing capabilities, limiting these features to paying subscribers on the social media platform X. This decision follows a significant global outcry and widespread condemnation over the chatbot's misuse to create and disseminate non-consensual sexualized images of women and children. Prior to the restrictions, users could prompt Grok to digitally alter images, often replacing clothing with revealing attire, and these images were sometimes publicly posted as replies on X.
The controversy has triggered swift reactions from governments and regulators worldwide. Indonesia became the first country to temporarily block access to Grok, citing the risk of AI-generated pornographic content. Simultaneously, a group of U.S. Democratic senators sent a letter to Apple CEO Tim Cook and Google CEO Sundar Pichai, urging them to remove X and Grok from their respective app stores until the platforms address policy violations related to the generation of harmful and potentially illegal depictions. In India, the Union government also issued a warning to X, threatening legal action if the platform failed to prevent the misuse of Grok for generating and circulating obscene and sexually explicit content, demanding an action-taken report. The UK Prime Minister and European officials have also expressed strong disapproval, with some threatening potential bans or further investigations under digital safety laws.
While xAI states it is urgently fixing safeguards, and Musk has said that users creating illegal content would face consequences, critics argue that merely restricting the feature to paying subscribers does not adequately address the underlying safety concerns and some have even suggested it monetizes the problem. Reports indicate that the standalone Grok app may have initially allowed non-paying users to continue generating such content, further fueling skepticism about the effectiveness of the restrictions.
Read the full story on Quick Digest