Scientific report writing has a tedious core: after reading dozens of papers, stitching their findings into one structured, citation-backed report. Ai2 (the Allen Institute for AI) has now split that job out and open-sourced it: AstaBrief-8B, the model behind the report-generation feature of its Asta research assistant, ships under Apache 2.0 with weights and training data on Hugging Face.
A cited report in 51 seconds
AstaBrief has a narrow job: take a research question plus retrieved literature excerpts and emit a complete, cited report in one pass. Per the official blog, across the full Asta pipeline the Fast mode averages 51.1 seconds per report, versus 178.5 seconds for the Claude-powered Thinking mode — roughly 3.5x. The speedup comes from a shorter pipeline, not a bigger model: it skips the expensive snippet-summarization and clustering stages that Thinking mode uses, and it refuses to write section by section, generating the final draft directly.
The recipe: real queries, two judges
The model starts from Qwen3-8B and skips RL in favor of a plain SFT+DPO recipe. SFT data comes from real user queries in Asta: after filtering out beta-tester and bot traffic, 90K research queries remained; the ScholarQA pipeline then generated target reports using a mix of Claude 3.5 Sonnet, Claude 3.7 Sonnet, o3, o4-mini and GPT-4.1, leaving 47K usable examples after quality filtering. DPO added about 6K pairs, with winners picked by two judges, GPT-4.1 and DeepSeek-R1; only pairs where both judges agreed were kept, and the judges' agreement with human preferences is reported at 95%. AI2's counter-intuitive finding: of the four statistical filters tested, the single most useful signal was simply whether synthetic reports consistently cite their claims — more aggressive combinations added little.
Read the self-reported numbers with care
On the ScholarQA-CS2 test set, the model card shows Qwen3-8B averaging 77.3, the SFT checkpoint 83.7, and the final DPO model 87; the win rate against Asta's original pipeline reaches 72% on test. The same table carries less flattering numbers too: on DeepScholarBench, AstaBrief scores 53.50, behind DR-Tulu's 56.26; and in a 14-question human study DR-Tulu won overall preference, though two of the three researchers preferred AstaBrief on citation accuracy. All of these are team-reported numbers, the evaluation was completed in 2025, and AI2 itself notes it has not rerun the comparison against today's frontier models.
So what
For research institutions, the practical point is self-hosting: the report-generation step can move behind their own firewall, so sensitive questions about unpublished work no longer need to reach a closed API. For the industry, this is a cheap-recipe sample — no heavy RL stack, just real queries, citation-density filtering and dual-judge preference pairs, and an 8B model holds most of the line against a proprietary pipeline on one specific task. The remaining question: once anyone can download the model, what moat is left in report generation?