On March 16, Mistral AI released Mistral Small 4 at NVIDIA GTC 2026. This is an architecturally ambitious product: merging the previously three independent models (Magistral reasoning, Pixtral multimodal, Devstral coding) into a single 119B MoE checkpoint, fully open-sourced under Apache 2.0.
Core data: 119B total parameters, MoE architecture activating 4 experts (only 6B active parameters per forward pass), 128K context window, latency reduced by 40% compared to three independent models. On the Artificial Analysis coding leaderboard, Mistral Small 4 surpasses GPT-5.4 Standard; pure reasoning capability still lags behind Claude Opus 4.6. Minimum deployment requirement is 4 NVIDIA HGX H100s.
I think what's worth attention about this release isn't the parameter scale, but the architectural integration thinking. MoE itself isn't new, but Mistral unifies three capabilities into a single MoE routing system — essentially using sparse activation for multi-task learning. This is far more economical than maintaining three independent models, with one API endpoint solving everything. For enterprise users who need to handle text, images, and complex reasoning simultaneously, this simplification is real value.
Apache 2.0 license is another key. With no commercial use restrictions whatsoever, fully privately deployable. In data-privacy-sensitive fields like healthcare and finance, the combination of "no capability compromise, full autonomy" is quite rare. Mistral also simultaneously released the Forge enterprise platform, supporting fine-tuning Small 4 on proprietary data — this is a clear action pushing open-source models into enterprise-grade production workflows.
Of course, this isn't comprehensive surpassing. Coding is slightly stronger than GPT-5.4 Standard, but pure reasoning still lags Claude Opus 4.6, and the 4×H100 threshold isn't friendly to small teams either. But for enterprises that already have GPU infrastructure and need to run multi-task models in their own environment, Small 4 offers a previously non-existent option: get reasoning, vision, and coding capabilities simultaneously in a single open-source model, with no usage restrictions whatsoever. The coverage of open-source models is expanding, and Mistral this time is taking an integration route, rather than continuing to stack parameters.