benchmarking
Posts tagged “benchmarking”.
-
AI Brief, 25 September 2026: the half of the benchmark nobody can see
The independent evaluation of Jev asked for here on the 24th arrived a day later, and it puts a 4B open model first and Jev second. The finding underneath the ranking is larger: on the 308 decisions held back from everyone, the best system in the field scores 36.7% against a 29.3% chance floor. Two typed-decision models launched into that result, one of them ranked 78th of 89 on it.