arXiv 2606.24773 introduces FMLM+ (Flow Matching Language Model Plus), a diffusion language model that achieves "self-correction" capability — a property previously considered exclusive to autoregressive (AR) models. The result: FMLM+ matches the quality of the discrete baseline with 32× fewer NFE (Number of Function Evaluations), the metric for diffusion model compute.
The "self-correction" property: AR models can naturally correct their own outputs — if a token is wrong, the model can revise it in a later step. Diffusion language models traditionally lack this — they generate all tokens "in parallel" and there's no natural way to "go back and fix." FMLM+'s fix: a "two-stage denoising" process where the first stage generates a rough draft, and the second stage "corrects" the draft by re-masking low-confidence tokens and re-generating them. The "correction" is learned end-to-end, not hand-designed.
The result: FMLM+ matches the discrete (AR) baseline on MMLU and HumanEval with 32× fewer NFE. At the same NFE, FMLM+ is 2-3 quality points above the discrete baseline. The "correction" mechanism is general and can be added to any diffusion LLM.
The bigger takeaway: diffusion LLMs are catching up to AR on the things AR was thought to be uniquely good at. "Self-correction" was the last big advantage of AR, and FMLM+ closes that gap. The "diffusion vs AR" debate is increasingly irrelevant — both can match each other on quality and speed, and the choice will be driven by use case (parallel generation, controllable generation, etc.).
For the industry, this signals that diffusion LLMs are entering the "production-ready" phase. The next round of competition will be in "diffusion LLM tooling" — inference frameworks, fine-tuning recipes, and deployment guides.