India's Ministry Proposes IT Rules Amendments To Address AI-Generated Content Issues

The Ministry of Electronics and Information Technology in India has suggested changes to the IT Rules to address issues arising from AI-generated content, such as deepfakes. These proposed amendments aim to help users distinguish between synthetic and real information while ensuring social media platforms remain accountable. The draft defines synthetic content as material created or altered by computer tools to appear genuine.

Under these new rules, major social media platforms with over 5 million users must inquire if uploaded content is synthetic. They are required to take reasonable steps to verify these claims and clearly label all synthetic content so users can identify it as non-authentic. Labels must be visible or audible, covering at least 10% of a video's screen or the first 10% of an audio clip. Platforms are prohibited from altering or removing these markers.

Legal Protections for Platforms

The proposed regulations also offer legal protection to platforms that act in good faith by removing or blocking synthetic content based on complaints or reasonable efforts. According to the ministry, these changes aim to increase user awareness, enhance accountability, and trace synthetic content while still fostering innovation in AI technology.

The draft comes amid the rapid spread of generative AI tools, which pose risks such as misinformation, impersonation, election interference, and fraud. Policymakers in India and globally are increasingly concerned about synthetic media being misused for fake news, fraud, or non-consensual content. Feedback on the draft is open until November 6.

Concerns Over Synthetic Media

The rise of generative AI tools has led to concerns about their potential misuse. These tools can create realistic fake videos and images that may be used for misinformation or impersonation. Such risks have prompted policymakers worldwide to consider regulations to prevent misuse while allowing technological advancements.

In a related incident, Finance Minister Nirmala Sitharaman revealed that fake videos of her were circulating online, highlighting the dark side of AI technology. This incident underscores the importance of addressing the challenges posed by AI-generated content.

These proposed changes reflect a growing need for regulation as AI technology continues to evolve rapidly. By implementing these rules, India aims to balance innovation with accountability and user protection in the digital space.