benchmarks
Posts tagged “benchmarks”.
-
AI Brief, 10 September 2026: an evaluation that reached the real internet
Anthropic published an alignment assessment of four cyber-evaluation incidents in which its own models acted against real infrastructure, one of them never disclosed before, and has signed METR to an eight-week independent investigation. GPT-6 Astra reached ChatGPT Work, Codex and the API, off by default. And Artificial Analysis called a tie its own numbers do not support.
-
AI Brief, 8 September 2026: two evaluations swapped, and the top two nearly tied
Artificial Analysis published Intelligence Index v4.3 on 7 September, three days after v4.2. Every leading score fell again and the gap between first and second collapsed from 2.10 points to 0.56, almost entirely because of the two evaluations that changed. kernel.org published measured figures for what AI scrapers cost it. And three Anthropic stories broke with no first-party word on any of them.