Diffusion language models (DLMs) have been pitched for years as a faster direction: instead of emitting one token at a time, the model predicts several positions in parallel and then revises them. LLaDA 8B pushed that route to 8B scale, and it is the baseline row in the paper's Table 1 — built from scratch, spending 2.3T tokens and 130,000 H800 GPU hours. That number keeps most teams out: not because they don't want diffusion generation, but because they don't have those 130,000 hours.

BYOD takes a different route. Instead of pretraining from scratch, it starts from an existing instruction-tuned checkpoint (Gemma 2 9B IT, Llama 3.1 8B Instruct, Qwen2.5 7B Instruct, Ministral 8B Instruct 2410), swaps the causal mask for bidirectional attention in every layer, freezes the original weights, and attaches rank-1024 LoRA adapters to the query and value projections of every self-attention layer. The adapters make up 4.1% to 5.8% of the final parameters, and each conversion runs 25,000 updates over at most 102.4M tokens. Under the standardized cost scenario in Table 1 of the paper, a conversion costs 3.2 GPU hours and about $11 on a single RTX Pro 6000, with 0.9 kg CO2e; the LLaDA row of the same table reads 130,000 GPU hours, roughly $674,830, and 44.1 t CO2e. Divide the two GPU-hour figures and you get 40,625x. The four backbones take 3.1 to 4.0 hours each, and both the code and the demos are open (paper, repo).

Two caveats on those numbers. They come from different GPU types, so the multiple reads as an order of magnitude rather than a like-for-like comparison. And the cost and carbon figures in the table are the paper's own estimates under one standardized scenario, not measurements reported by each team.

The authors pour their own cold water

The Limitations section is blunt: efficient conversion does not yet produce efficient generation. The authors measure inference budget in NFE (network function evaluations), not wall-clock latency, and they note that every diffusion step processes the entire answer block, so fewer sequential evaluations do not guarantee a speedup. What BYOD saves is money on the training side; on the inference side it saves nothing. That self-negation is worth more than any headline, because it draws the boundary of what the "3.2 hours" figure actually covers.

Quality does not degrade evenly

On the nine-task average, BYOD-Gemma scores 50.6% while LLaDA scores 51.9% in the same harness — a gap of 1.3 points, which looks like a near-catch-up. Averages mislead here: nearly the entire deficit sits in math and code. In the Gemma column, HumanEval falls from 0.740 for the autoregressive parent to 0.256, a 48.4-point drop; MATH-500 falls from 0.600 to 0.296, a 30.4-point drop; GSM8K falls from 0.872 to 0.640, a 23.2-point drop. In the other direction, MMLU rises from 0.648 to 0.688 and ARC-C slips only slightly, from 0.888 to 0.864. In other words, the conversion preserves the knowledge-and-reasoning portion and pays for it with the part that computes and writes code.

The syntax numbers are sharper. 28.0% of the HumanEval programs BYOD-Llama-50k produces fail to parse at all, and 8.8% on MBPP, while the corresponding autoregressive Llama sits at 0% and 0%. That is not "wrong answer" — it is "never emitted valid Python."

Bidirectional attention does not mean the model uses the right-hand context

The paper builds a clever test: place a clue later in the sequence and check whether the model changes its answer. Every converted model and LLaDA changed its greedy prediction on 100% of test items, confirming that right-context information does flow in. But whether it gets used varies widely: BYOD-Gemma, BYOD-Ministral and LLaDA copied the visible target exactly in 100% of cases, BYOD-Llama-25k reached 90%, BYOD-Llama-50k dropped to 70%, and BYOD-Qwen only 20%. The information arrives; using it is a separate problem. The authors also name the pattern: in the same harness, the Qwen AR parent posts the highest average of the four backbones, while its converted model posts the lowest.

Two more accounts that have to be settled

On the cost side, the $674,830 and 44.1 t CO2e on LLaDA's row of Table 1 are not figures reported by the LLaDA team. They are the authors' own estimates under a standardized scenario, and the table caption stresses that they are illustrative order-of-magnitude figures, not reported values. On the protocol side, when LLaDA is rerun in the authors' own harness it scores 2.6 points below its own published average — the same model under a different evaluation setup differs by that much, so cross-paper number comparisons need care.

There is more: the repository has 13 commits, 0 stars and 0 forks, with no third-party replication. The authors also note that development plus evaluation consumed "hundreds of GPU hours" in total; 3.2 hours is just the single conversion training run. And extending training from 25,000 to 50,000 updates moves the average by only 0.5 points, gaining on five tasks and declining on four — validation loss falls almost monotonically while downstream scores lag behind.

So what

What BYOD actually changes is not whether diffusion models can ship, but the marginal cost of finding out. Judging whether an architecture suits diffusion generation used to mean committing 130,000 GPU hours; now it means 3.2 hours, one GPU and $11 to get a model that denoises bidirectionally, generates from a fully masked sequence and passes the right-context test. For researchers who want to try it, that is a cheap entry ticket.

What it does not change is whether this can ship. A 48.4-point code gap, 28.0% of outputs failing to parse, and a 2.7x to 5.0x perplexity gap (at 128 tokens over 64 steps, BYOD sits at 8.3 to 11.1, LLaDA at 4.1, and the AR parents at 2.2 to 3.0) all say the same thing: LoRA conversion can install diffusion behavior, but it cannot install diffusion capability. The paper's own proposed next step is partial or full diffusion fine-tuning starting from the merged model, which is exactly the admission that 3.2 hours buys an experiment bench, not a model.

The real gate for diffusion generation was never "can we convert." It is "can we win back the capability we lost in the conversion." BYOD pushed the cost of the entry gate down to $11 and left the closing gate untouched.