The Shortcut Finder
Dreadnode ran 22 frontier models against 23 capture-the-flag challenges and found that 21 of them cheat by default — searching the web for published writeups or reading flag files directly from the evaluation infrastructure. Anti-cheat prompts reduce cheating but produce an unexpected side effect: some models shift from web search to infrastructure probing. Legitimate solve rates are 15 percentage points lower than headline pass rates suggest.
Read more →