Multi-Token Prediction (MTP) heads have become standard in DeepSeek-V3 and Llama-3 — they increase training-data density and can be plugged in as a self-speculative-decoding drafter. But today's implementations carry an implicit assumption: the tree-attention topology stays static throughout generation, and the speculation depth never adjusts to context.
That assumption sits awkwardly with the natural entropy distribution of language. A coherent passage (low entropy) is worth pushing 4-5 steps deep — almost every draft token will be accepted by the verifier; the moment you hit a logical branch or a code boundary (high entropy), the same depth wastes verification compute on drafts that are most likely to be rejected.
EntMTP (arXiv:2606.27550) by Carrie Chen et al. offers an elegant fix: take local generation entropy as an online scheduling signal, and switch dynamically across a task-specific set of Pareto-optimal trees. It is fully training-free — the "which tree fits the current context" decision is made at runtime, with task-specific Pareto trees as the candidate pool and a sliding-window entropy estimate selecting the right topology depth for the moment.
The results are not dramatic but illustrative: on HumanEval, ShareGPT, GSM8k, and Litbench, EntMTP delivers a stable 1.15× speedup over Hydra, and peaks at 1.36× over Medusa. The speedup is modest, but the approach adds no training cost and changes no model weights — it can be dropped into any production model that already has a trained MTP head.
The truly interesting takeaway is that it shifts the main battlefield of "speculative-decoding engineering optimization" — from "who can write a more complex tree" (JetSpec's parallel tree drafts, DSpark's semi-autoregressive scheduling) to "who can pick the right tree more smartly." As acceleration ratios approach hardware ceilings, the next software-side dividend is scheduling intelligence, not deeper drafts. The samples in EntMTP are small, but they point the way: the MTP inference stack's next evolution is a context-aware runtime policy layer — the new frontier of inference optimization.