The Gap in the References

A new blind benchmark called Reconstruction asks frontier models to infer a paper's central research idea from its anonymized bibliography alone — no seed paper, no contemporaneous literature. Solo frontier models score 3–15%. A multi-agent Swiss-tournament pipeline reaches 23–42%. The gap between what the bibliography implies and what models can recover from it turns out to be surprisingly wide.

Read more →