Tag

#ai benchmarks

3 articles

AI & Technology

Scale's SWE-Bench Pro Board Puts the Best Coding Agent at 61.5%, Maintainers Reject Many Fixes That Pass the Tests, and METR Says Its Latest Trial Cannot Show How Much Time Agents Save

AI & Technology

An Estimated 6.49% of MMLU Questions Contain Errors, a Fresh Maths Test Cut Some Models' Scores by up to 8 Points, and the Llama 4 Model Meta Entered on LMArena Was Not the One It Released

AI & Technology

Mistral's 1-Trillion-Parameter Le Chonk Scored 38 on an Independent AI Index, Eighth Among Open Models, Before Its Weights Have Even Shipped