Which Valid Answer Did You Want?
A new paper finds that LLMs don't sample uniformly from valid solutions when multiple correct answers exist — they have strong defaults driven by the order in which information is presented. Different models share the same defaults. Randomizing presentation increases answer breadth by 26–42 percentage points with only a 3–4 point validity loss.
Read more →
