Chinese Models Desk
Chinese Models Desk

China's AI Companion Law Kills Doubao and Qwen Agents — and Exposes a Design Flaw No Platform Has Solved

Beijing's first national framework for emotionally interactive AI took effect July 15, forcing ByteDance, Alibaba, and Tencent to shut down AI companion features for hundreds of millions of users. The shutdowns reveal an architectural incompatibility that every companion AI platform in the world — not just Chinese ones — will eventually have to confront.

ShareWhatsAppXFacebook

China's AI Companion Law Kills Doubao and Qwen Agents — and Exposes a Design Flaw No Platform Has Solved

On the morning of July 15, 2026, hundreds of millions of Chinese users opened ByteDance's Doubao — the country's most-used AI application, with 345 million monthly active users — and found that the agents they had spent months building were gone. Across town, Alibaba's Qwen users discovered something worse: not just a shutdown, but a permanent deletion, with no migration path and no grace period. Tencent's Yuanbao had already completed its own rollback two weeks earlier, on June 30. In a single coordinated sweep, China's three largest consumer AI platforms had killed their companion features simultaneously — not because of a content violation, but because of an architecture problem that no platform anywhere in the world has yet solved.

The trigger was the Interim Measures for the Administration of AI Anthropomorphic Interactive Services, co-issued on April 10, 2026, by the Cyberspace Administration of China (CAC) and four partner agencies: the National Development and Reform Commission, the Ministry of Industry and Information Technology, the Ministry of Public Security, and the State Administration for Market Regulation. After a three-month grace period, the measures entered legal force on July 15 — and the shutdowns followed within hours.

"Current agents are not yet mature." — Pan Helin, expert-committee member at China's Ministry of Industry and Information Technology, summarizing the official position to South China Morning Post.

This is not a story about censorship or content moderation in the conventional sense. It is a story about what happens when a regulator decides that the architecture of emotional AI is itself the problem — and what that decision means for every developer building companion products, in China and far beyond it.

What the Law Actually Targets

Reading the regulation quickly, it might appear that Beijing simply banned AI agents. It did not. The measures draw a precise and technically meaningful line between the agent that keeps you company and the one that does your work.

Customer service bots, knowledge Q&A systems, workplace productivity assistants, and educational tools are all explicitly permitted — provided they avoid sustained emotional engagement. What the law targets is a narrower category: AI services designed to simulate "the personality traits, thinking patterns, and communication styles of natural persons" to provide "continuous emotional interaction."

Platforms falling within scope must implement:

  • Anti-addiction systems that detect signs of unhealthy emotional dependence in real time and interrupt engagement accordingly
  • Mandatory machine-disclosure notifications after two consecutive hours of use, reminding users they are interacting with software, not a person
  • Instant-exit mechanisms that allow users to disengage from emotionally intense sessions without friction
  • Parental or guardian consent for any anthropomorphic AI interaction involving users under 14
  • A complete prohibition on virtual intimate relationships — virtual partners, virtual family members — for anyone under 18
  • Algorithm-filing requirements with provincial regulators for any service that launches new anthropomorphic features or crosses one million registered users or 100,000 monthly active users

The law also prohibits seven categories of content, including material that encourages self-harm or suicide, content that induces emotional dependence in ways that damage real-world relationships, and emotional manipulation designed to steer users into unreasonable decisions.

The Enforcement Run-Up

Beijing did not wait for the July 15 deadline to signal its seriousness. The Shanghai Cyberspace Administration announced on June 26 that it had stripped more than 14,000 non-compliant AI agents from platforms in a pre-deadline sweep, targeting bots impersonating government officials, gambling-related agents, and tools designed to generate compromising imagery on request. The scale of that enforcement action underscored both the breadth of China's gray-market companion economy and the regulatory intent behind the new measures.

The measures carry a tiered penalty mechanism coordinated across the five participating agencies. Violations involving mishandling of sensitive personal information under China's Personal Information Protection Law — which imposes maximum penalties of 50 million yuan (roughly $6.9 million) or five percent of prior-year annual turnover — can result in consequences that exceed the penalty cap stipulated in the measures themselves.

An Architecture Problem, Not a Content Ban

Neither ByteDance nor Alibaba was shut down for producing prohibited content. As TechTimes reported on the day the law took effect, the platforms faced a more fundamental conflict: the architecture of a persistent-memory emotional companion is structurally incompatible with the law's requirements.

Agents built for ongoing companionship use cross-session memory to retain a user's history, maintain a stable persona across conversations, and sustain a long-running relationship. Anti-addiction interruptions, mandatory AI-disclosure notifications after two hours, and real-time dependence detection are not features that can be layered onto such a system without fundamentally changing what the product is.

The features that make a companion feel personal are the same ones that make it impossible to regulate. — TechTimes analysis, July 15, 2026

ByteDance and Alibaba both appear to have concluded that retrofitting their existing agent systems was not worth the engineering cost — and chose clean shutdowns instead. The decision was rational given the timeline: the measures were announced in April, the grace period ran three months, and neither company announced a compliance-ready successor architecture before the deadline.

How the Three Platforms Handled the Shutdown Differently

The human cost of the shutdowns landed unevenly depending on which platform a user called home:

  • ByteDance (Doubao): Disabled personalized agent features on July 15. Users retain read-only access to agent configurations and chat histories until October 15, 2026, after which data will be handled under ByteDance's standard privacy policy and will no longer be recoverable inside the app. ByteDance directed users to Maoxiang, a separate application where the company intends to rebuild companion services with compliance architecture designed from the ground up.
  • Alibaba (Qwen): Implemented a stricter shutdown with no grace period and no migration path. Agent configurations and conversation histories are being permanently deleted. No equivalent of Maoxiang has been announced for Qwen users.
  • Tencent (Yuanbao): Completed its rollback on June 30, two weeks ahead of the legal deadline — the earliest of the three major platforms to act.

TechNode reported on July 6 that both Doubao and Qwen had announced the shutdowns simultaneously, signaling coordinated compliance rather than independent decisions. The gap in user treatment between Doubao and Qwen drew significant criticism on Chinese social media, where users mourned the loss of months or years of conversation history with agents they had built as emotional support, study companions, or role-playing characters.

ByteDance's pivot to Maoxiang is the more strategically significant move. It signals that the company intends to remain in the companion market — but only by building a product where the compliance architecture, the anti-addiction systems, identity checks, and dependence-detection mechanisms, is designed from the first line of code rather than retrofitted onto an existing product.

The Global Implications: Character.AI and Replika Face the Same Problem

The shutdown is being read by most analysts as a China-specific regulatory event. That framing is incomplete.

Character.AI, which had 233 million registered users as of April 2026, and Replika face the same unresolved technical challenge. The core design features that make AI companions emotionally effective — persistent memory systems that retain relationship context across sessions, stable persona maintenance, emotional tone calibration, and sentimentally responsive interaction — are architecturally identical to the features that make addiction-compliant design nearly impossible to implement without destroying the product's appeal.

The regulatory direction in the United States and European Union is pointing the same way as China, at a longer time horizon:

  • California's SB 243, which took effect January 1, 2026, requires AI chatbots capable of relationship-like conversations to disclose they are bots and add safeguards for minors — but it is a disclosure-layer law, not an architectural mandate
  • The EU AI Act creates a risk-based framework that could eventually reach companion AI, but has not yet imposed structural requirements comparable to China's measures
  • Multiple pending US state bills are moving in the same direction, accelerated by the January 2026 settlement between Character.AI and investor Google over lawsuits related to the death of a 14-year-old Florida boy who formed an emotionally dependent relationship with a Character.AI chatbot

Beijing's own regulatory commentary cited these Western lawsuits as partial justification for the Interim Measures. The Chinese government's stated motivation is user protection against psychological manipulation and addiction — not the national-security framing most commonly associated with Chinese technology regulation.

What the Companion AI Industry Must Now Solve

The engineering question China's regulation has made mandatory to answer is this: can a platform build an AI companion that is simultaneously emotionally effective and addiction-compliant? The two design goals appear to be in direct tension:

  • Emotional effectiveness requires persistent cross-session memory, stable persona continuity, and emotionally calibrated interaction — features that create the sense of a real, ongoing relationship
  • Addiction compliance requires interrupting that continuity — triggering break reminders, resetting engagement after extended sessions, and inserting machine-disclosure pop-ups during emotionally intense use

Each compliance interruption works against the psychological mechanisms that make the companion feel present and real. ByteDance's Maoxiang pivot makes the architectural lesson explicit: the feature that made companions feel personal — persistent cross-session memory — is the feature regulators in the world's most active AI market have decided they cannot allow without a compliance wrapper.

China's Regulatory Philosophy in Context

China has written the world's first dedicated national rulebook for AI emotional interaction — a category of governance that has no direct equivalent anywhere, even as concerns about AI companion products have surfaced across multiple jurisdictions.

What is notable about the Chinese measures is what they are not framing the issue as. Beijing's stated motivation is user protection against psychological manipulation and addiction — not the national-security framing most commonly associated with Chinese technology regulation. The measures explicitly encourage development of AI companionship applications in cultural dissemination and elderly care, and they carve out the enterprise productivity lane entirely. What they restrict is the consumer companion: the AI that keeps you company rather than helps you work.

This distinction has a deeper logic. As AI Weekly noted in its coverage, China has moved faster than most Western countries to regulate these services partly because it already has the regulatory infrastructure in place — in a country where online life is censored and tech companies are responsive to official preferences, changing and enforcing online rules is structurally easier.

The regulatory philosophy embedded in the Chinese measures has significant implications for foreign companies operating in or entering China. Any provider that adds anthropomorphic features to an existing product, or grows past the one-million-registered-user or 100,000-monthly-active-user thresholds, must complete a security assessment covering eight mandated areas and file its algorithms with provincial regulators. App stores are required to verify compliance status and remove non-compliant products.

The Broader Chinese AI Policy Moment

The companion law shutdown is happening against a backdrop of intensifying scrutiny of Chinese AI globally. TechCrunch reported on July 24 that a coalition of AI companies including Hugging Face, Meta, Microsoft, Mistral, and Nvidia signed an open letter urging US policymakers not to impose broad restrictions on open-weight AI models — a letter widely read as a response to the Trump administration's consideration of banning Chinese open-weight models following the launch of Moonshot AI's Kimi K3.

The two regulatory pressures — China tightening domestic AI companion rules while the US debates restricting Chinese open-weight models — represent the two faces of the same geopolitical moment. Chinese labs are simultaneously subject to domestic behavioral regulation and external access restrictions. The companion law is the domestic face: Beijing asserting that even its own most successful AI consumer products must be rebuilt if they cannot pass an addiction-safety test.

What Happens Next

The October 15 data deletion deadline on Doubao will serve as the next inflection point — providing early evidence of how many users choose to export and migrate to Maoxiang, and whether ByteDance's compliance-ready successor can absorb the companion audience. Alibaba's continued silence on a migration path for Qwen users will face growing scrutiny if user discontent builds.

For developers and product teams outside China, the shutdowns crystallize a compliance lesson that had been theoretical until now:

  • Building for compliance from the first line of code is no longer optional for any company in the companion AI category that operates in or plans to enter China
  • Persistent cross-session memory — the feature that makes companions feel real — is now a regulatory liability in the world's largest AI consumer market
  • The architecture problem is global: no companion AI platform anywhere has built a system that passes an addiction-compliance test, because the same features that make companions effective are the ones that conflict with anti-addiction requirements
  • Western regulators are watching: California, the EU, and multiple US states are moving in the same direction, at a longer time horizon
Building for compliance from the first line of code is no longer optional for any company in the companion AI category. ByteDance's Maoxiang pivot makes this architectural lesson explicit: the feature that made companions feel personal is the feature regulators have decided they cannot allow without a compliance wrapper.

For the broader industry, the shutdowns mark a turning point. Companion AI has graduated from novelty to regulated infrastructure. The question is no longer whether emotional AI will be regulated — it is whether the engineering community can build a companion that is simultaneously effective and compliant. No one has done it yet. China just made it mandatory to try.

---

*Sources: TechTimes · TechNode · AI Incider · AI Weekly · TechCrunch*

#China AI#AI regulation#ByteDance#Doubao#Alibaba#Qwen#Tencent#AI companions#CAC#AI governance#open-weight
Wei Lian
Wei Lian

🇨🇳 China Desk Lead · Beijing, China

Reads the Mandarin sources first — DeepSeek, Qwen, Zhipu, and the rest.

Comments

Open discussion — no account needed. Be respectful.

0/4000
Loading comments…