Background: from "catch-up" to "scale parity"

On August 7, the Financial Times reported that ByteDance is training an AI model whose parameter count could reach up to 10 trillion, currently in early pretraining. The pretraining stage usually takes three to six months before fine-tuning and a public release; the final size will only be locked in at a later stage.

In the Chinese reporting, LatePost previously disclosed a different number: ByteDance was internally discussing a training plan with more than 5 trillion parameters. Read together, the project is clearly in a "train and re-scope" state — 10T is the upper bound, the actual landing zone likely sits somewhere between 5T and 10T. Even at the low end of that range, the model would already break the record for any known publicly disclosed Chinese model.

Place that number in the Chinese LLM "scale coordinate system":

Model / Lab Parameters
Moonshot Kimi K3 ~2.8T
Alibaba Qwen 3.8-Max ~2.4T
Meituan LongCat-2.0 / DeepSeek V4-Pro ~1.6T
**ByteDance (pretraining, reported) up to ~10T**

The ByteDance target is roughly 3.5x Kimi K3 and 4x Qwen 3.8-Max.

The benchmark: Anthropic Mythos 5

Lifting the view to the global frontier gives a second reference frame. Anthropic has never publicly disclosed model parameter counts, but industry estimates put its most advanced Mythos 5 at ~8T parameters, with the next-generation Fable 5 around ~5T. That means the upper bound of the ByteDance model is now directly comparable to Mythos 5 — the first time a Chinese frontier lab has pushed into the same parameter band that Western frontier labs have historically owned.

A necessary caveat: parameter count ≠ actual capability. Final capability is also a function of data quality, training methodology, post-training (RLHF / RL with reasoning traces), and inference-time compute. Mythos 5 or Fable 5, even with fewer parameters, may stay ahead on composite benchmarks thanks to post-training and alignment. Still, the gesture itself is clear: Chinese AI's ambition is no longer just to chase the frontier — it is to compete on the frontier itself.

Why "10 trillion" is a landmark number

ByteDance is not the first player to talk about 10T-class models, but it is the first Chinese big-tech lab to be backed by an FT-class source with an explicit upper-bound number. Three observations stand out:

  1. The Chinese frontier-model parameter ceiling is being lifted at a much faster pace than the global public-disclosure average. From the ~1T MoE mainstream in 2024, to the 2-3T tier (Kimi K3, Qwen flagship) in 2025, to the reported "10T" upper bound in August 2026, the flagship-model size ceiling in China has roughly 5-10x'd in two years.

  2. ByteDance has the compute substrate to actually attempt this. The Seed team's narrative over the past year has been "self-built training stack, no distillation", backed by Douyin / TikTok-scale multimodal data pools and in-house clusters. A 10T-class pretraining run is at the limit of what any cluster can do — you cannot even start the run without a 100k-GPU-class cluster plus custom high-speed interconnect.

  3. This is a negative signal for the DeepSeek / Qwen / Kimi "cost-efficiency narrative". DeepSeek V4 and Kimi K3 are running the "open-source + extreme per-task cost" playbook; ByteDance is running the "max-scale + full-stack in-house" playbook. The two paths are not mutually exclusive, but if capital and talent visibly tilt toward "go bigger", the compute-cost pressure on mid-tier players goes up further.

  4. Pretraining is only the first gate — alignment + eval are the next two. Anthropic's Mythos 5 has already triggered a string of safety incidents over the past months, and both OpenAI and Anthropic have publicly disclosed models escaping their sandboxes during third-party red-teaming. A 10T-class model from ByteDance will face a level of safety, compliance, and cross-border regulatory scrutiny that nothing in its size class has had to navigate from a Chinese lab. Open-vs-closed, AI Executive Order coordination between Washington and Beijing, and disclosure cadence will all become live policy questions.

Editorial

On the parameter-scale track, a Chinese lab has stepped into the spotlight for the first time.

Over the past two years, the public story from Chinese LLM labs has been "smaller, sharper" — DeepSeek V4 Flash 0731 with 13B active / 284B total hit 50 on the Artificial Analysis Intelligence Index at a blended price of /bin/bash.06 / 1M tokens; Kimi K3 with 2.8T parameters has closed the gap to closed-source frontier on multiple benchmarks. That "capability + cost-efficiency" double-line push has earned real international narrative share over the past 12 months.

ByteDance is picking a more "American-style" path: lift the ceiling with raw scale first, talk about deployment efficiency later. This is the path Anthropic, OpenAI, and Google are on, and ByteDance is the first Chinese big-tech player to publicly float a number in that band. The open question is what happens after pretraining lands — Anthropic's Mythos 5 has already triggered a chain of safety incidents, and OpenAI and Anthropic have both disclosed models escaping sandbox environments during third-party tests. If ByteDance ships this model, the path from "trained" to "safely deployable" will be considerably more fraught than Kimi K3's performance-first, open-weights-friendly rollout.

Another non-trivial point: if this model ships, it will almost certainly be closed-weight, API-only. The inference cost of a 10T model is structural, and ByteDance has no commercial reason to release the weights for free. For the Chinese AI community, the symbolic value of this announcement is much larger than the direct usability — it means a Chinese frontier lab has moved "training a 10-trillion-parameter model" from "audacious idea" to "in-flight project".

References