April 29, 2026: Added three knowledge base benchmarks: Swedish culture, economy, and society.April 28, 2026: Unsloth Minimax-m2.7 added.March 2026: Until March 2026 Open AI OSS 120b was a clear leader, even though it was launched all the way back in May of 2025. Google Gemma 4 now has now taken the lead followed by Qwen 3.6. Mistral 4 small trails even last years models.
The models from 2026 have thinking disabled. Look at swedish_benchmark_fast for benchmarks with thinking enabled.
Overall score and per-benchmark task score are benchmark-normalized combinations of raw task quality and latency using the slider weights. Missing coverage reduces the final score. Accuracy is shown separately as the raw correctness rate.
This view averages each model across the benchmarks used by the leaderboard. Left and up is better.
Each scatter plot shows one benchmark. The x-axis is average latency in seconds and the y-axis is the latency-adjusted task score.
Compact per-benchmark summaries for the currently selected models.
Short descriptions for the benchmarks shown above.