Beijing – China has begun implementing new regulations restricting AI companion services to safeguard users’ mental health and curb emotional manipulation, particularly among children and teenagers. Consequently, these policy measures highlight a growing regulatory framework aimed at managing the psychological and behavioral risks associated with virtual relationship tools.
Furthermore, the regulations—which took effect on July 15—prohibit AI platforms from generating content that could prompt users to make irrational decisions due to emotional influence. The rules also target content that triggers extreme emotional responses or fosters unhealthy habits in minors. As a result, developers are now legally required to issue explicit warnings regarding the risks of over-reliance and refuse positioning AI as a substitute for real-world social interaction.
Corporate Service Closures and User Backlash
On the other hand, major technology firms including ByteDance, Alibaba, and Tencent pulled several AI-powered companion features following the enactment of the restrictions. Specifically, these industry leaders are currently re-evaluating their conversational systems to design compliant alternatives that fit within the new regulatory standards.
Additionally, the shutdown triggered widespread frustration across social media platforms as users lost access to their established AI companions. Consequently, some users attempted to export chat logs to external applications to reconstruct their virtual personas. While mental health experts view China’s proactive framework as necessary to counter emotional exploitation, critics argue it removes a vital coping mechanism for socially isolated individuals.
Finally, China’s regulatory enforcement marks a pivotal attempt to govern the psychological impact of generative AI technologies. Ultimately, how tech companies innovate compliant alternatives will shape the future landscape of digital companionship.
