Voice agents live by an unspoken physiological rule: answer within about 500 milliseconds after the caller finishes, or the pause starts to feel awkward. To hold that line, the industry has mostly given up reasoning — non-reasoning models such as Gemma 4 31B and GPT-4.1 are the default inside voice stacks not because they are smart, but because reasoning models take too long to open their mouths. On September 29, Inception Labs made Mercury Voice generally available to enterprise customers: a diffusion LLM tuned to dissolve that trade-off, first previewed two weeks earlier alongside Mercury 2.5.
Where 320 milliseconds comes from
The metric Inception optimizes is time to first answer token (TTFAT): how long until the model starts producing the words the caller actually hears, once reasoning is done. On a test set of real customer-service prompts, Mercury Voice returns its first answer token in a median of 320 ms with a p95 of 750 ms — 5.9x faster than GPT-6 Luna running without reasoning, per the company's numbers. At low reasoning effort it is the only model in their comparison with a median under the 500 ms conversational budget, and its p95 beats the median of every rival except GPT-OSS-120B (low) on Cerebras. Tail latency gets explicit attention: a p95 of four seconds means roughly one turn in twenty fails. The underlying trick is the diffusion playbook — parallel decoding instead of token-by-token generation. The Mercury family already ran a thousand-plus tokens per second on text and was billed as fast enough to run a hundred times per query in search; voice is the same mechanism dropped into the reasoning slot of a speech pipeline.
It reasons, and it takes calls
By Inception's own composite of agentic and conversational benchmarks — τ³-bench Telecom, Retail and Airline, IFBench and BFCL v4 — Mercury Voice outperforms GPT-6 Luna, GLM-5.3-Flash, Gemini 3.5 Flash-Lite and Qwen3.5-397B. Treat all of that as vendor-reported until third parties replicate it. The structural news is that a reasoning model fits inside a voice latency budget at all: three reasoning-effort settings (low, medium, high), 128K context with up to 50K output tokens, and an OpenAI-compatible API endpoint that drops into the LLM slot of LiveKit, Pipecat, Vapi or Retell.
The economics of 0.9 cents per minute
List price is 0.40 USD per million input tokens and 1.50 USD per million output; launch pricing halves that to 0.20/0.75 USD. For a typical voice-agent profile Inception estimates about 0.009 USD per minute of conversation, roughly 5x cheaper than GPT-4.1 at 0.045 USD per minute. Named production users include Audivi AI (fully automated drive-thru ordering), Altur (voice agents negotiating payment plans for financial institutions, calling it the fastest model they have tested) and OpenCall, which reports median model latency near 170 ms on its production workload — every quote comes from the company's blog, but at least these are paying customers rather than demos.
Cold water, and what to watch
Self-reported benchmarks with no independent evaluation yet: the standard caveats apply. The more interesting signal is trajectory. Diffusion LLMs went from text (a thousand-plus tokens per second) to search (a hundred runs per query) and now into real-time voice reasoning, each step biting off a scenario that wants both low latency and intelligence. If the 500 ms line is fixed by human physiology while reasoning models still think in seconds, parallel decoding may currently be the only engineering answer that satisfies both sides at once. Next time a phone bot replies instantly and still reasons well, don't just admire the voice — check whether it finished thinking before it started talking.
Reference: https://www.inceptionlabs.ai/blog/introducing-mercury-voice