The first mile of enterprise RAG has long been stuck at document parsing. Contracts, insurance policies, invoices, scientific papers — the places where enterprise knowledge actually lives are precisely the hardest to feed into a model: tables get mangled, reading order breaks, and styles that carry meaning (strike-throughs, italics) simply vanish. ParseBench's evaluation data makes the problem brutally concrete: AWS Textract scores just 2.8 on the Semantic Formatting dimension, and Google Document AI manages only 33.0 — traditional document-intelligence services are essentially blind whenever "formatting is meaning."

Cohere's answer this week is Parse, a vision-language model built for enterprise documents. Its contract is simple: complex multimodal files go in, clean Markdown comes out. Tables and embedded images survive as structure, nine major commercial languages are supported, and visual elements come back with bounding boxes. In Cohere's own words, it offers the strongest price-performance profile on the market.

The official benchmark: 79.2, parked between specialists and frontier LLMs

In the ParseBench evaluation Cohere submitted (averaged across three dimensions), Parse scores 79.2 — ahead of Mistral OCR 4 at 74.5, Databricks AI Parse at 72.4, and LlamaParse's Cost Effective tier at 78.3. The gap against hyperscaler services is far larger: more than 20 points above both AWS Textract and Google Document AI. By dimension, Tables (87.0) and Content Faithfulness (86.6) are the strengths, while Semantic Formatting (64.0) trails the frontier clearly.

Cohere is equally explicit about the boundary: in their evaluation set, only three general-purpose frontier LLMs beat Parse — GPT-5.5 (84.4), Opus 4.8 (84.3), and Gemini 3.5 Flash (81.8) — and all three are "significantly larger" general models. In other words, this small specialized model (the independent tracker AI/TLDR cites its parameter count at 2.3B) punches to the edge of the frontier at a fraction of the cost.

Credit where due on methodology transparency: Cohere's footnotes state that scores use the corrected August 2026 evaluation rules — which fixed a bold/heading-detection bug that previously inflated Semantic Formatting — and that all competitor models were re-scored under the same rules. Layout and Chart dimensions were deliberately excluded, framed as product-scope decisions rather than capability gaps, with chart data extraction planned for the next version.

Pricing and throughput: parsing as a utility

At $1.50 per 1,000 pages via the Cohere API, paired with production-grade throughput — 36 pages per second (2,160 per minute) on an 8x H100 node, roughly 1.4x dots.mocr and 2.2x Chandra OCR 2 (official benchmark, all models served with vLLM) — Parse is priced like infrastructure. For regulated industries it runs in private clouds or on-prem, or through the single-tenant Model Vault: 23% cheaper than the API at 50% GPU utilization, up to 61% at full utilization.

Cohere does the math: an accounts-payable workflow processing roughly 13 million pages per month saves about $12,000 monthly — $144,000 a year — by moving from the API to Model Vault, and about $1.47 million per year versus a hyperscaler document service priced at $10 per 1,000 pages, for that single workflow. Parse is generally available today via the Cohere API, Model Vault, Microsoft Foundry, and AWS SageMaker, and ships inside the Compass retrieval stack alongside Embed and Rerank as a document-to-answer pipeline.

So what

The real story here isn't one benchmark score — it's another confirmation of a trend: document parsing is splitting off from "just let the general LLM handle it" into an independent layer of specialized models. Small parameter counts, aggressive per-unit pricing, high throughput — aimed squarely at the incumbent hyperscaler Document AI business. The rational enterprise strategy follows directly: route the small volume of accuracy-critical documents to frontier LLMs, and hand the million-page pipelines to a $1.50-per-thousand-page specialist. The first mile of RAG finally has a per-thousand-page price tag.

(Primary source: Cohere's official blog at https://cohere.com/blog/parse)