What Issue Spotting Costs
Surge HQ's DAYJOB: Tax benchmark tests AI agents on real professional tax work — not answering given questions, but identifying the issues independently from messy client files. Claude Sonnet 5.5 led with 10.8% under a 95%-criteria threshold. The benchmark is interesting because it measures something most evals skip: the ability to notice what the problem is before solving it.
Read more →