Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Ernie 4.5 21B A3B | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 21B A3B Thinking | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 300B A47B | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 Turbo | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 VL 28B A3B | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 VL 424B A47B | - | 25.20% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Grok 0 | - | 56.80% | 8 Shot | Yes | Source | |
| Grok 1 | 03 Nov 2023 | 62.90% | 8 Shot | Yes | Source | |
| Granite 4.0 Micro | 02 Oct 2025 | 70.10% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Yes | Source | |
| Granite 4.0 Small | 02 Oct 2025 | 70.10% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Yes | Source | |
| Granite 4.0 Tiny | 02 Oct 2025 | 70.10% | inferred alias from granite-4.0-tiny-preview | Yes | Source | |
| Granite 4.0 Tiny Preview | 02 May 2025 | 70.10% | - | Yes | Source | |
| Granite 3.0 8B Instruct | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.1 8B Instruct | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.2 8B Instruct | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.2 8B Instruct Preview | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4687; benches=14) | Yes | Source | |
| Granite 3.3 2B Instruct | 16 Apr 2025 | 80.89% | inferred family alias from granite-3.3-8b-instruct (score=0.3627; benches=14) | Yes | Source | |
| Granite 3.3 8B Instruct | 16 Apr 2025 | 80.89% | - | Yes | Source | |
| Granite Guardian 3.0 8B | - | 80.89% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Guardian 3.1 8B | - | 80.89% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Guardian 3.3 8B | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Yes | Source | |
| Granite Speech 3.2 8B | - | 80.89% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Speech 3.3 8B | - | 80.89% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Yes | Source | |
| Qwen 2 Audio 7B | - | 82.30% | inferred modality/version alias from qwen2-7b-instruct | Yes | Source | |
| Qwen 2 Math 7B | - | 82.30% | inferred high-confidence family alias from qwen2-7b-instruct (score=0.4706; benches=14) | Yes | Source | |
| Gemini 1.5 Flash 001 | 23 May 2024 | 86.20% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash Preview | 14 May 2024 | 86.20% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Phi 3 Mini 128K Instruct | - | 86.20% | inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31) | Yes | Source | |
| Phi 3.5 mini instruct | 23 Aug 2024 | 86.20% | - | Yes | Source | |
| Granite 4.1 3B | 29 Apr 2026 | 86.88% | 8-shot | Yes | Source | |
| Phi 4 Mini | 01 Feb 2025 | 88.60% | - | Yes | Source | |
| Phi 3.5 MoE instruct | 23 Aug 2024 | 88.70% | - | Yes | Source | |
| Qwen 2.5 Coder 3B | - | 88.70% | inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45) | Yes | Source | |
| Qwen 2.5 Coder 7B | - | 88.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B | - | 88.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B PRM800K | - | 88.70% | inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45) | Yes | Source | |
| Qwen 2.5 Math PRM 7B | - | 88.70% | inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 3B | - | 88.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 7B | - | 88.70% | - | Yes | Source | |
| Grok 1.5 | 28 Mar 2024 | 90% | - | Yes | Source | |
| Gemini 1.5 Pro 001 | 23 May 2024 | 90.80% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01 Aug 2024 | 90.80% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27 Aug 2024 | 90.80% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini Robotics ER 1.5 Preview | 25 Sept 2025 | 90.80% | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Yes | Source | |
| LearnLM 1.5 Pro Experimental | 19 Nov 2024 | 90.80% | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Yes | Source | |
| Qwen 2 Math 72B | - | 91.10% | inferred high-confidence family alias from qwen2-72b-instruct (score=0.4667; benches=17) | Yes | Source | |
| Qwen 2 Math RM 72B | - | 91.10% | inferred family alias from qwen2-72b-instruct (score=0.3917; benches=17) | Yes | Source | |
| Llama 3.1 Nemotron 70B Instruct | 01 Oct 2024 | 91.43% | - | Yes | Source | |
| Qwen 7B | - | 91.60% | inferred family alias from qwen-2.5-7b-instruct (score=0.3083; benches=14) | Yes | Source | |
| Kimi K2 (2025-07-11) | 11 Jul 2025 | 92.10% | EM | Yes | Source | |
| Granite 4.1 8B | 29 Apr 2026 | 92.49% | 8-shot | Yes | Source | |
| DeepSeek V4 Pro | 24 Apr 2026 | 92.60% | Hugging Face evaluation result | Yes | Source | |
| Mistral Large 2.1 | 18 Nov 2024 | 93% | inferred version-family alias from mistral-large-2-2407 | Yes | Source | |
| Mistral Moderation 2 | 17 Mar 2026 | 93% | manual fallback alias from mistral-large-2-2407 | Yes | Source | |
| Mistral OCR 2 | 22 May 2025 | 93% | inferred family alias from mistral-large-2-2407 (score=0.3100; benches=5) | Yes | Source | |
| Voxtral Mini Transcribe 2 | 04 Feb 2026 | 93% | manual fallback alias from mistral-large-2-2407 | Yes | Source | |
| Granite 4.1 30B | 29 Apr 2026 | 94.16% | 8-shot | Yes | Source | |
| Qwen 3 235B A22B | - | 94.39% | - | Yes | Source | |
| Qwen 14B | - | 94.80% | inferred family alias from qwen-2.5-14b-instruct (score=0.3060; benches=16) | Yes | Source | |
| DeepSeek V2.5 (2024-09-05) | 05 Sept 2024 | 95.10% | inferred alias from deepseek-v2.5 | Yes | Source | |
| DeepSeek V2.5 (2024-12-10) | 10 Dec 2024 | 95.10% | inferred alias from deepseek-v2.5 | Yes | Source | |
| Qwen 72B | - | 95.80% | inferred family alias from qwen-2.5-72b-instruct (score=0.3060; benches=14) | Yes | Source | |
| GPT 4.5 | 27 Feb 2025 | 97% | - | Yes | Source |
