Tencent's WeChat started gray-beta of its AI assistant "Xiaowei" (小微), a built-in AI feature inside the WeChat app. The architecture is dual-model: WeLM (Tencent's self-developed LLM) for general conversation, and DeepSeek-V4 for code and complex reasoning. The target user base: WeChat's 1.432 billion monthly active users.
The product design: Xiaowei is positioned as a "WeChat-native Agent" — it can read chats (with permission), summarize group messages, draft replies, and book services through WeChat mini-programs. The killer feature: it can "act on behalf of the user" within WeChat, e.g., ordering food via Meituan mini-program or booking a doctor's appointment through a hospital mini-program.
The technical challenges: (1) latency — Xiaowei must respond in under 1 second to feel native to WeChat; (2) privacy — the Agent must work with strict permission controls (the user can choose which mini-programs Xiaowei can access); (3) cost — at 1.4B users, even $0.001 per inference is $1.4M per day.
The dual-model approach: WeLM handles 80% of general conversation (cheap, fast), DeepSeek-V4 handles 20% of complex reasoning (more expensive, slower). A lightweight router decides which model to use per request, optimizing for cost-quality trade-off.
The bigger takeaway: "1.4B-user Agent" is a category that has never existed before. WhatsApp, Telegram, and other messaging platforms will follow suit. The "Agent as a native feature" paradigm is replacing the "Agent as a separate app" paradigm, and the platform with the largest user base (WeChat) has the biggest advantage. For the industry, this signals that the next Agent wave will be inside messaging apps, not as standalone products.