arXiv 2606.16140 introduces VibeThinker, a 3B-parameter reasoning model from Weibo AI that hits the top of the reasoning leaderboard — beating several flagship models on math and code reasoning. The standout: 3B is enough to match 70B+ models on focused reasoning tasks.
The "small but focused" design: VibeThinker is a 3B model trained exclusively on math, code, and logic reasoning — no general chat data. The focused training allows the 3B model to develop deep reasoning capabilities that would be diluted in a general-purpose model. The training uses a combination of curated reasoning datasets and RL with verifiable rewards.
The benchmark: on the MATH benchmark, VibeThinker-3B scores 89.2, beating GPT-5.6 (87.4) and Claude Opus 4.7 (88.1). On HumanEval, VibeThinker scores 82.5, on par with Claude Sonnet 4.6 (82.1). The model is fully open-sourced.
The "small model paradox": the Weibo team argues that "small focused models" can beat "large general models" on specific tasks. The intuition: a 3B model with all its capacity dedicated to reasoning can develop deeper capabilities than a 70B model that must also handle chat, translation, summarization, etc.
The bigger takeaway: "task-specific small models" are the future of reasoning AI. The "bigger is better" assumption is breaking in the reasoning domain, and focused small models can match or beat general flagships. For the industry, this means enterprises should consider deploying "small specialist reasoning models" instead of relying on a single large general model. The cost savings (10-30× cheaper inference) are significant, and the quality is often better.