As the frontier of large language models shifts from "chatting" to "getting work done," IBM has delivered its answer: the Granite 4.2 family of open language models, released in 3B, 8B, and 30B sizes, all featuring native chain-of-thought reasoning ("thinking"), under an Apache 2.0 license that allows direct commercial use (official announcement: https://research.ibm.com/blog/introducing-granite-4-2). It is a clear bet on enterprise agent scenarios — the model is no longer just generating replies, but planning, calling tools, and self-correcting inside multi-step tasks.
Native chain-of-thought, built as a three-way switch
The most interesting product decision in Granite 4.2 is making "thinking" an explicitly switchable mode: in thinking mode the model outputs full step-by-step reasoning before the answer; non-thinking mode skips reasoning and answers directly; low-effort thinking performs minimal reasoning, with an internal monologue as short as a single "Simple answer." All three levels are toggled via chat template parameters — no model swap required.
Tool calling is integrated with reasoning as well: the model first reasons about which tool to call and why, then makes the call, with tools defined using the OpenAI function schema. Software engineering agents that can navigate codebases, handle multi-step development tasks, and operate in terminal environments were a primary training target.
Training pipeline: multi-stage RL + 1T tokens of synthetic code
According to IBM Research, these capabilities come not from parameter scale but from a redesigned training process. Granite 4.2 is post-trained on top of Granite 4.1 base models: supervised fine-tuning first, then multiple reinforcement learning phases. The first stage, "foundational RL," was applied to all three sizes, strengthening math, science, coding, reasoning, and tool calling, combining verifiable rewards with reward-model-based evaluation. The 8B and 30B models continue with a specialized "agentic RL" phase focused on enterprise-style tasks — software engineering, terminal-based coding, and search-driven workflows — followed by RLHF alignment.
Two further ingredients: training incorporated 1 trillion tokens of synthetic code generated with IBM's CodeAlchemy pipeline, and an intermediate "mid-training" step shown to unlock additional reasoning power. On the inference side, a speculative decoding layer outputs text faster while serving more users, directly cutting enterprise serving costs. IBM is also working with Hirundo to apply machine unlearning to reduce undesirable outputs without fully retraining the models.
Benchmarks: the 30B takes the top SWE Bench Pro score in its class
Evaluations cover AIME25 (reasoning), LiveCodeBench v6 (coding), IFBench and τ³-bench (instruction following), BFCL v4 (tool calling), plus SWE Bench Pro and Terminal-Bench 2.1 (agentic). The results are clearly stratified: at 3B, Granite leads decisively across all tasks; at 8B, it matches or exceeds competitors on reasoning and instruction following and is the only model in its size class reporting SWE Bench Pro results; at 30B, Granite achieves the highest SWE Bench Pro score and stays competitive across all benchmarks against similar or larger models.
A bonus speech model: 470M parameters hitting RTFx 12,600
Released alongside are Granite Speech 5.0 Turbo CTC and a non-commercial CTC NC variant: 470-million-parameter CTC models with no LLM backbone, aimed at laptops, smartphones, and other edge devices. In IBM's testing the Turbo CTC model reached roughly 12,600 RTFx on a single H200 GPU, versus around 6,000 for the speed leaders on the Hugging Face Open ASR leaderboard — twice the throughput, transcribing three hours of audio in about a second, well suited to high-volume workloads like call-center analytics.
So what
In a 2026 where everyone races toward trillion-parameter MoEs, IBM's differentiated route — dense architecture plus a three-level reasoning switch plus Apache 2.0 — doesn't chase the absolute intelligence ceiling; it makes models "smart enough, auditable, and privately deployable" to a degree enterprises will actually trust. For teams building private agents, a fully open family where 3B leads its tier across the board, 8B runs the full agent evaluation suite, and 30B goes toe-to-toe with larger models deserves a spot on the shortlist. In the enterprise market, licensing and deployment freedom often speak louder than a leaderboard crown.