Peer review rests on a default assumption: several reviewers read a paper independently and step on different problems. A 1990 study observed that two reviewers often shared no critical point at all. That assumption is now shaking: a paper measures that the reviews of one ICLR paper increasingly repeat each other at the level of problems.

Overlap up 9.3 points in one year

The paper (https://arxiv.org/abs/2611.26286) has a single author, Ilya Gusev of Keenable, Amsterdam. It covers 85,466 ICLR papers and 299,168 reviews from 2020 to 2027; the 2027 batch is a snapshot taken eight days after the reviews became public and before decisions. The measurement is claim-level, not whole-text similarity: GPT-6 Luna first splits each review into critique claims, claims pointing at the same problem are grouped, and an overlap coefficient is computed for each pair. The pipeline is itself validated: against human labels on 218 Nature-family reviews, Luna's quotes fall inside 96.7% of the labeled items; Sol 6.1, DeepSeek V4.1 Flash and Kimi K3.1 Pro independently redo extraction and grouping, every contrast keeps its sign, and overlap levels float between 10.9% and 14.8% depending on the model. ICLR overlap rose from 12.0% in 2026 to 21.3% in 2027, up 9.3 points in one year; the author stresses both years hold discussion-phase reviews, so the comparison is directly comparable. NeurIPS, ICML, F1000 (+5.8 points) and PLOS (+2.5 points) also rose in their latest cycles.

The deeper accounting is more telling. Claims per review did not fall (7.2 to 7.3), but distinct problems across three reviews dropped from 19.9 to 19.0, fewer than any year since 2020; the new problems a third review adds shrank from 6.12 to 5.46; shared problems per pair jumped from 0.61 to 1.10. In short, reviewers write as much, but their critiques converge.

Three counter-checks

Using the MELD detector (threshold at the 99.9th percentile of 110,080 pre-2023 scores), the author flags reviews likely touched by AI. Within one paper, pairs of two flagged reviews overlap more than pairs of two unflagged ones: by 3.0 points at ICLR 2024-2025, by 4.5 points in 2026-2027, and by 5.4 points pooled over five journal sources. Three counter-checks follow. Polishing the language of 600 pairs of human reviews raises overlap by only 0.5 points; rewriting each from an outline of its points, by 0.9 points - both far below the 3.0-to-4.5-point gap. Forcing a top-45% flag rate on pre-ChatGPT ICLR data yields gaps of -3.3 to +0.2, so a high detector score alone does not produce the gap. Re-running with the GigaCheck detector keeps the direction.

The cold water the author pours

Limitations stated in the paper itself: of the 9.3-point rise, unflagged pairs account for only 3.7 points while the other 5.6 points go with flagged reviews, and the paper says this split is an accounting, not a causal effect of LLM use. A flag does not mean machine-written - 39.5% of polished reviews get flagged; an unflagged review is not thereby human-written. Detector labels must not support action against an individual reviewer. NeurIPS and most journals publish reviews of accepted papers only. Two questions stay open: how much of the rise comes from LLM use that leaves no trace in the text, and whether the 2027 level holds after the discussion phase. For the record, the code and text of this very paper were written by Claude Fable 5.2 and GPT-6 Astra, with the authors as supervisors and editors.

So what

The mechanism is not an isolated case: Anderson et al. (https://arxiv.org/abs/2402.01536) found LLM assistance homogenizes ideas across writers, and Doshi and Hauser reported in Science Advances that individual creativity rises while collective diversity falls. The paper also cites Ghosh et al. (https://arxiv.org/abs/2611.17811): AI reviewers draw more than half of their weaknesses from the appendix, and in sampled ICLR reviews that share rose from 11.3% to 27.6%. Nor is this new: Liang et al. quantified the spread of ChatGPT-modified conference review text at ICML back in 2024, and Pangram judged 21% of ICLR reviews likely AI-generated; this work simply pushes the granularity down to problems. The uncomfortable policy blind spot: the ICML 2026 randomized policy trial tracked length and scores - reviews got 5.5-7% longer with scores almost unchanged - but nobody measured diversity of critiques. The value of peer review rests exactly on several readers finding different problems; as the third reviewer adds fewer new ones, the marginal value of an extra reviewer shrinks. For authors the lesson is blunt: do not assume three reviews cover three blind spots - they may be converging into one.