Back in January, DeepSeek R1 stunned the world with its 671-billion-parameter reasoning breakthrough powered by reinforcement learning. Now, Alibaba's Qwen team has released QwQ-32B — a reasoning model with only 32 billion parameters that nonetheless matches DeepSeek R1's performance across benchmarks.
The key to this breakthrough is a Scaling RL strategy. Like R1, QwQ-32B uses a cold-start checkpoint and trains in math and coding domains with outcome-based rewards, leveraging accuracy verifiers and code-execution servers to evaluate solution quality. As training progresses, math and coding abilities keep improving; later a general-capability RL stage is added to further extend the model's generalization.
The second-stage RL takes only a few steps to enhance general abilities like instruction-following and human-preference alignment, without significantly sacrificing math and coding performance.
More notably, QwQ-32B weaves agent capability into the reasoning model, letting it call tools during reasoning and adapt based on environmental feedback. This is an important step toward agentic reasoning — reasoning is no longer just "thinking," it can truly "act."
As an open-source model (Apache 2.0 licensed), QwQ-32B achieves performance on par with 671-billion-parameter DeepSeek R1 at 32B scale, demonstrating a more efficient trade-off between reinforcement learning and model scale. It proves that reasoning-capability gains don't necessarily require proportional parameter growth, pointing the way for open-source community efforts to boost reasoning in smaller models.
But challenges remain: instability in RL training, high hyperparameter sensitivity, and reproducibility issues are all hurdles on the path to engineered deployment.