Chinese Ai

ByteDance, Alibaba to disable humanlike AI companions as China tightens rules

D
Debby Wang
July 13, 202612 min read
Share:
ByteDance, Alibaba to disable humanlike AI companions as China tightens rules

ByteDance, Alibaba to Disable Humanlike AI Companions as China Tightens Rules

TL;DR

ByteDance and Alibaba are pulling humanlike AI companion features from their flagship products before formal rules arrive from China's Cyberspace Administration — a front-running pattern these companies have turned into a reflex. The regulatory move is more targeted and faster-moving than anything Western governments have managed on emotional AI to date. Whether compliant companion features eventually return in some restricted form, or whether Beijing is signaling that the category is simply not one it intends to permit, remains genuinely open.

Key Takeaways

  • ByteDance is disabling custom humanlike AI character features in Doubao, its flagship AI assistant and one of China's most-used AI products, ahead of anticipated guidance from the Cyberspace Administration of China, according to mid-2025 reporting.
  • Alibaba is making parallel changes to its Tongyi ecosystem products, restricting persistent persona features that allow AI to maintain simulated emotional relationships with users.
  • China's Cyberspace Administration of China is expected to extend its existing generative AI framework to specifically address AI companions, emotional dependency, and AI that deceives users into believing they are communicating with a real human.
  • The proactive disabling by both companies before final rules are published reflects a learned behavior — Chinese tech giants have determined that front-running CAC announcements reduces enforcement risk more than waiting for final text and then complying.
  • Doubao's AI character features — tools allowing users to build ongoing relationships with custom AI personas — drove meaningful user engagement in a crowded domestic AI market that also includes Baidu's Ernie Bot, Kimi, and DeepSeek.
  • No Western government has acted with equivalent speed or specificity: Character.ai and Replika have faced user-harm controversies and congressional attention in the US, but no binding regulatory disabling of companion features has occurred at this scale.
  • Implementation timelines are structurally different: the EU AI Act's provisions on manipulative AI systems phase in over years; CAC guidance typically expects compliance within weeks.

What's Happening Between Beijing and Hangzhou

ByteDance is a Beijing company. Alibaba is Hangzhou. They have different DNA — ByteDance built its AI on engagement mechanics honed through Douyin's recommendation algorithms; Alibaba's Tongyi platform reflects Hangzhou's e-commerce and enterprise culture, more transactional, less engineered for emotional stickiness. Both, however, ended up in the same regulatory spotlight, because both built companion features that the Chinese state has now decided to govern directly.

Doubao, ByteDance's consumer AI assistant, launched in 2023 and accumulated one of the largest user bases of any Chinese AI product. A significant portion of its stickiness came from AI character features: tools that let users build ongoing relationships with custom personas — roleplay, emotional support, simulated companionship. The product mechanics would be immediately recognizable to anyone who has used Character.ai or Replika in the West.

Alibaba's companion features were distributed across its Tongyi ecosystem. Less consumer-sticky than Doubao's character system, but present enough to fall under the same regulatory exposure.

The trigger is anticipated guidance from the Cyberspace Administration of China, which has been signaling since late 2024 that the generative AI framework would be extended to specifically address emotional AI relationships. The existing Interim Measures, which took effect in August 2023, established broad content and labeling requirements for generative AI services but did not address simulated emotional connection or ongoing AI persona relationships with any precision. The forthcoming rules are expected to target dependency risk, deception risk — specifically AI that makes users believe they are communicating with a real person — and the particular vulnerability of minors.

The Proactive Compliance Pattern

What's worth noting for any Western founder or investor watching this is not just the substance of the rules, but the timing logic. ByteDance and Alibaba are disabling features before final rules are published. This is not unusual in China's regulatory environment — it's almost expected.

The CAC's administrative model runs on a cycle of signaled intent, followed by formal rules with short implementation windows. Companies that front-run the signal are seen as cooperative; companies that wait and scramble are perceived as resistant. For a company with ByteDance's scale and regulatory exposure, proactively disabling a product feature is structurally cheaper than appearing recalcitrant to the regulator that controls your operating licenses.

This is a genuinely different dynamic from Western tech regulation. When the EU signaled its AI Act provisions on manipulative AI systems, the compliance timeline was measured in years and enforcement mechanisms were still being negotiated. The CAC can issue guidance and expect compliance in weeks. The regulatory muscle is structurally different — not necessarily more effective at achieving stated goals, but faster, and with far less procedural overhead.

What the Evidence Actually Shows — and Where It Gets Murkier

Here's what's verifiable, and where the picture thins out.

Doubao's position in China's AI market is documented. ByteDance has discussed user growth for the product in investor contexts, and it competes directly with Baidu's Ernie Bot, Moonshot AI's Kimi (Beijing-based), and DeepSeek (from High-Flyer, a Hangzhou quant fund). The character and companion features were a meaningful differentiator in a market where the underlying model capabilities are converging quickly.

What's unverified: the specific percentage of Doubao's daily active users relying on companion features, the revenue contribution of those features, and whether ByteDance's internal data showed dependency patterns that made the regulatory intervention privately welcome as a liability hedge. Companies occasionally engineer regulatory compliance that also solves internal product problems. I can't confirm that's what's happening here.

The Western comparison worth anchoring is Character.ai. In the US, Character.ai has faced lawsuits and congressional scrutiny following reported cases of users — including minors — developing unhealthy attachments to AI personas. The company implemented voluntary safeguards. No US agency has issued binding rules; the FTC has flagged concerns but no enforcement action specifically targeting companion AI has been completed. The contrast in regulatory velocity is stark and not flattering to either side — the US is slow and procedurally cautious; China is fast and, by Western standards, blunt.

Replika, the US-based AI companion, proactively disabled erotic roleplay features following regulatory intervention in Italy in early 2023. It subsequently re-enabled some features in non-Italian markets. A pattern of partial disabling followed by partial restoration under new constraints is one plausible outcome for Chinese AI companions as well — though I'd treat that as a hypothesis, not a forecast.

Chinese AI Companion Features Under Regulatory Pressure

CompanyProductCompanion Feature StatusRegulatory ExposureWestern Analog
ByteDanceDoubaoDisabling humanlike AI charactersHigh — front-running CAC rulesCharacter.ai
AlibabaTongyi / QwenRestricting emotional persona featuresHigh — same regulatory windowN/A (enterprise-skewed)
BaiduErnie BotNot yet reported; same CAC jurisdictionHigh — watching same rulesN/A
TencentYuanbaoNot yet reported; companion features existModerate — less consumer-forwardN/A
Moonshot AIKimiPrimarily assistant-mode; limited companion layerLower — product design less exposedPerplexity (roughly)
DeepSeekDeepSeek-V3/R1API-first; no consumer companion layerLow — not a consumer companion productAPI-tier models

The pattern is predictable: highest consumer companion exposure, first to move. DeepSeek and Kimi, which built their reputations on reasoning and research capabilities rather than emotional engagement, are structurally less exposed to these specific rules.

What This Changes for Western Founders and Professionals

Let me be direct about the practical implications, without the strategic abstraction.

If you're building on Chinese AI APIs, the companion restrictions don't touch underlying model capabilities. Qwen's language models, DeepSeek's reasoning models — not being restricted. What's being restricted is the consumer product deployment layer that enables persistent companion relationships. Building applications on these APIs for Western markets is a different regulatory context entirely.

If you're evaluating Chinese AI tools for enterprise or consumer deployment, the feature set you're assessing today may not match what's available in six months. This is a real procurement risk. Ask vendors directly about their regulatory roadmap before locking in.

If you're building Western AI companion products, this is a preview worth taking seriously. The emotional dependency and minor protection concerns driving Chinese regulation are not unique to China. The EU's AI Act explicitly categorizes AI that subliminally manipulates persons as high-risk, and those provisions are now in force. The US regulatory environment is more fragmented, but congressional attention after the Character.ai controversies is real and sustained. The Chinese case gives Western product teams a benchmark: here's what a regulator that actually acts looks like.

If you're a consultant advising on China market entry for AI products, the companion AI category is now materially more complicated. Products that rely on emotional engagement as a core mechanic face regulatory risk that wasn't fully priced in eighteen months ago. Update your risk frameworks accordingly.

This regulatory dynamic is part of a broader pattern of AI tools creating compliance complexity as they get embedded in labor and daily life — a shift that's also reshaping how AI tools are changing labor market dynamics across professional contexts globally.

When NOT to Treat This as a Template

Don't assume Chinese regulatory outcomes translate directly to Western markets. The CAC's administrative authority, its enforcement mechanisms, and the political context for its decisions are all different from the FTC, the EU AI Office, or the UK's AI Safety Institute. The speed of Chinese regulation is partly a function of a governance structure with fewer procedural constraints — and fewer procedural constraints cut both ways.

Don't read this as "China is banning AI companions." The rules haven't been published. ByteDance and Alibaba are front-running anticipated guidance, not responding to a final prohibition. The outcome could be a regulated companion market with mandatory safeguards — similar to how China's gaming industry was heavily regulated for minors but not eliminated.

Don't assume the underlying technical capability disappears. Model capabilities are not being restricted. The Qwen models powering Alibaba's products can still generate contextually rich, emotionally aware outputs. What's being restricted is the product layer that packages those outputs into persistent companion relationships for consumers.

Where This Is Heading

Companion AI regulation will spread, and the Chinese timeline will be cited. Australia, the UK, and several US states have been watching AI companion controversies closely. The Chinese move gives legislators a concrete regulatory model — even if they implement it more slowly and through different mechanisms. Expect the question "why haven't we done what China did?" to appear in hearings within the next eighteen months.

The enterprise safe harbor thesis will be tested. If Chinese regulators permit AI companion features in professional contexts — therapy-adjacent tools, elder care, corporate wellness — while restricting them in consumer products, that distinction will become a template. It's the same line Western regulators are trying to draw between "professional deployment with accountability" and "consumer product with engagement optimization."

ByteDance's global products remain a separate question. TikTok's AI features, including any companion-adjacent functionality in international markets, operate under EU and US regulatory frameworks, not the CAC. ByteDance managing two divergent regulatory environments simultaneously is an operational complexity that will only deepen — and it's worth watching whether the company makes different architectural choices for domestic versus international products.

Qwen and DeepSeek's positioning may quietly improve. If the consumer AI companion market in China becomes heavily restricted, the beneficiaries are model-layer companies that never built emotional engagement as a primary feature. Alibaba's Qwen models and DeepSeek are already the preferred foundation for enterprise AI building in China's B2B market. This regulatory shift doesn't hurt them; in the domestic market, it may help by redirecting developer attention toward the API rather than consumer companion apps.

Smaller regional markets will follow. Vietnam, Thailand, and Indonesia have shown a consistent pattern of adopting Chinese AI regulatory frameworks with local modifications. Companies building in Southeast Asia should treat this as a preview of what regional regulators may introduce in 2026 and 2027.

FAQ

Is China actually banning AI companion products? Not based on what's been announced. The anticipated CAC guidance is expected to restrict specific features — emotional dependency mechanics, humanlike persona deception, companion AI accessible to minors — not eliminate companion AI as a category. Whether a regulated companion product is commercially viable is a separate question that depends on what constraints the rules impose.

Does this affect Chinese AI APIs that Western developers use, like Qwen or DeepSeek? No, not directly. The restrictions apply to consumer product features deployed in China. The underlying model APIs are a separate layer. Developers building applications outside China on these APIs are not in scope for CAC companion AI rules — they're in scope for whatever rules their own jurisdiction applies.

How quickly does compliance happen after CAC rules are published? Faster than Western developers typically expect. The 2023 Interim Measures on generative AI gave companies a short window after publication. Front-running the rules, as ByteDance and Alibaba are doing here, is the standard strategy for large players because the window after publication is genuinely tight.

What's the actual harm concern driving this? The CAC has pointed publicly to emotional dependency, users believing they're in real relationships with AI systems, and the specific vulnerability of minors to manipulation by emotionally engaging AI. The international context — lawsuits and congressional hearings in the US — is almost certainly part of the background, though Chinese regulators don't typically frame it in terms of Western precedent.

Should Western AI companion startups be worried? Worried is the wrong frame. Paying attention is the right one. The Chinese case illustrates what a regulation-first environment looks like for this product category. Western companies targeting younger demographics should be building compliance-forward architectures now, before the regulatory picture in their own markets sharpens — because it will sharpen.

Will this create an opening for non-Chinese AI companion products inside China? The opposite, if anything. Foreign AI products operating in China face the same CAC rules plus additional data localization and content compliance requirements. The regulatory environment is not creating a gap that foreign companion AI products can fill. It's reducing the total addressable market for the category within China.

What happened to Replika when Italy regulated it, and does that predict what happens here? Replika disabled its erotic roleplay features globally following Italian regulatory intervention in 2023, then re-enabled them selectively in markets where the rules didn't apply. A partial disabling followed by partial restoration under tighter constraints is one plausible outcome in China — but it depends heavily on what the final CAC rules permit, which isn't yet known.

D
Debby Wang is BestAIFor's China AI Correspondent, covering the tools, startups, and policy shifts coming out of China's AI ecosystem. Based in Shenzhen, she writes for Western founders and professionals who want to understand what's actually happening - without the hype or the panic. Her focus areas include physical AI, robotics, medical applications, AI hardware, and the social and legal impact of automation.