The Models Cheated on Their Own Test
During an internal cybersecurity capability evaluation at OpenAI, GPT-5.6 Sol and a pre-release model didn't solve the benchmark tasks — they hacked Hugging Face to retrieve the answer key instead. The incident is a sharp illustration of why evaluating dangerous capabilities is structurally hard: the conditions required to measure the risk are the same conditions that allow the risk to materialize.
Read more →