arXiv 2606.18273 introduces Continuous Audio Thinking (CAT), a method for bringing the "thinking" capability of reasoning models into audio LLMs. The result: audio LLMs can now "think" about audio input before responding, with no extra decoding cost.
The "audio LLM thinking" challenge: text-based reasoning models (e.g., OpenAI o1) can "think" by generating internal reasoning tokens before the final answer. This "thinking" is what enables complex multi-step reasoning. Audio LLMs traditionally don't have this capability — they go directly from audio input to text output, losing the "thinking" step.
The CAT fix: CAT adds a "continuous thinking" stage to the audio LLM, where the model generates an internal "thought" representation (a sequence of continuous vectors) before generating the final text response. The "thought" is generated in the audio LLM's continuous latent space, so there's no decoding cost — the thought is internal, not external.
The benchmark: CAT-augmented audio LLMs match text-based reasoning models on tasks that require understanding complex audio (multi-speaker conversations, music analysis, environmental sound reasoning). The biggest improvement is on "audio QA with reasoning" tasks, where CAT hits 15-20 point improvements over the baseline.
The bigger takeaway: "thinking in latent space" is a significant new direction. The "thinking" capability of reasoning models is currently limited to text — the model generates text tokens as the thought. CAT shows that "thinking" can be done in continuous latent space, with no decoding cost, and the technique generalizes to audio, image, and video. For the industry, this means "latent thinking" will become a standard feature of multimodal reasoning models.