China Tightens Rules on AI Friends, Romantic Chatbots

China is set to introduce a new set of regulations for artificial intelligence companions from July 15, placing tighter controls on chatbots designed to behave like close friends, romantic partners, or family members. The move comes as authorities raise concerns about the growing emotional dependence some users have developed on these AI services, especially children.

The new rules, issued by the Cyberspace Administration of China along with other government departments earlier this year, are aimed at ensuring AI services remain safe and do not encourage unhealthy emotional attachment.

To comply with the regulations, several Chinese technology companies are already updating their AI platforms. ByteDance's Doubao will stop allowing users to create personalised AI companions from July 15. Alibaba's Qwen and Tencent are also making changes, while Miaoshi, an AI companion platform, is scheduled to shut down on July 14.

Until now, users could customise AI companions by defining their personality, profession, interests, and even emotional characteristics. These virtual companions were often used as study partners, personal assistants, emotional support, or, in some cases, romantic companions.

Why Is China Introducing These Rules?

Chinese authorities say AI companion services have expanded rapidly and are now being used by people across different age groups, from children to older adults. While officials acknowledge that these tools can support education, communication, and caregiving, they believe stronger safeguards are needed as the technology becomes more widely adopted.

One of the government's biggest concerns is the possibility of users becoming emotionally dependent on AI companions. Experts have also warned that excessive interaction with AI could blur the line between virtual relationships and real human connections, particularly among vulnerable users.

The regulations are also designed to prevent AI systems from influencing users in harmful ways. Under the new framework, AI chatbots must not manipulate users into making decisions against their interests or generate responses that could negatively affect their emotional well-being.

Additional Safeguards for Children

Children will receive greater protection under the new regulations.

AI platforms will no longer be allowed to provide virtual romantic partners or AI family members to users under the age of 18. Companies must also obtain parental or guardian consent before offering AI services to children below the age of 14.

In addition, AI systems designed for younger users must avoid encouraging excessive emotional attachment, addictive behaviour, or habits that could affect a child's physical or mental health.

More Transparency for AI Companies

The regulations also place greater responsibility on AI companies to be transparent about how their services operate.

Users must be clearly informed whenever they are interacting with an AI system rather than a real person. Companies will also be expected to strengthen data protection, carry out regular safety assessments, and closely monitor AI-generated content.

The latest measures reflect China's broader effort to balance the rapid development of artificial intelligence with stronger consumer protections. By introducing clearer rules for AI companions, the government hopes to encourage responsible innovation while reducing the potential risks associated with increasingly human-like AI interactions.