Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Grok 0 | - | 39.70% | 0 Shot | Yes | Source | |
| Phi 3 Mini 128K Instruct | - | 62.80% | inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31) | Yes | Source | |
| Phi 3.5 mini instruct | 23 Aug 2024 | 62.80% | - | Yes | Source | |
| Grok 1 | 03 Nov 2023 | 63.20% | 0 Shot | Yes | Source | |
| GPT 4 32K 0613 | 13 Jun 2023 | 67% | inferred high-confidence family alias from gpt-4-0613 (score=0.4899; benches=12) | Yes | Source | |
| GPT 3.5 Turbo 16K 0613 | 13 Jun 2023 | 68% | inferred family alias from gpt-3.5-turbo-0125 (score=0.4244; benches=8) | No | Source | |
| GPT 3.5 Turbo (2023-11-06) | 28 Sept 2023 | 68% | inferred modality/version alias from gpt-3.5-turbo-0125 | No | Source | |
| GPT 3.5 Turbo Instruct | 06 Nov 2023 | 68% | inferred high-confidence family alias from gpt-3.5-turbo-0125 (score=0.5539; benches=8) | No | Source | |
| Phi 3.5 MoE instruct | 23 Aug 2024 | 70.70% | - | Yes | Source | |
| Pixtral 12B | 17 Sept 2024 | 72% | inferred version-family alias from pixtral-12b-2409 | Yes | Source | |
| Grok 1.5 | 28 Mar 2024 | 74.10% | - | Yes | Source | |
| Gemini 1.5 Flash 001 | 23 May 2024 | 74.30% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash Preview | 14 May 2024 | 74.30% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.0 Ultra | 06 Dec 2023 | 74.40% | - | No | Source | |
| Qwen 2.5 Coder 3B | - | 78.70% | inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45) | Yes | Source | |
| Qwen 2.5 Coder 7B | - | 78.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B | - | 78.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B PRM800K | - | 78.70% | inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45) | Yes | Source | |
| Qwen 2.5 Math PRM 7B | - | 78.70% | inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 3B | - | 78.70% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 7B | - | 78.70% | - | Yes | Source | |
| Qwen 2 Audio 7B | - | 79.90% | inferred modality/version alias from qwen2-7b-instruct | Yes | Source | |
| Qwen 2 Math 7B | - | 79.90% | inferred high-confidence family alias from qwen2-7b-instruct (score=0.4706; benches=14) | Yes | Source | |
| Codestral (2025-07-30) | 30 Jul 2025 | 81.10% | inferred version-family alias from codestral-22b | Yes | Source | |
| Codestral (2024-05-29) | 29 May 2024 | 81.10% | inferred modality/version alias from codestral-22b | Yes | Source | |
| Codestral (2025-01-13) | 13 Jan 2025 | 81.10% | inferred modality/version alias from codestral-22b | Yes | Source | |
| Granite 4.1 3B | 29 Apr 2026 | 81.71% | pass@1 | Yes | Source | |
| Granite 4.0 Micro | 02 Oct 2025 | 82.40% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Yes | Source | |
| Granite 4.0 Small | 02 Oct 2025 | 82.40% | inferred high-confidence family alias from granite-4.0-tiny-preview (score=0.4700; benches=12) | Yes | Source | |
| Granite 4.0 Tiny | 02 Oct 2025 | 82.40% | inferred alias from granite-4.0-tiny-preview | Yes | Source | |
| Granite 4.0 Tiny Preview | 02 May 2025 | 82.40% | - | Yes | Source | |
| Phi 1 | - | 82.60% | inferred family alias from phi-4 (score=0.3100; benches=13) | Yes | Source | |
| Phi 2 | - | 82.60% | inferred family alias from phi-4 (score=0.3100; benches=13) | Yes | Source | |
| Phi 4 | 12 Dec 2024 | 82.60% | - | Yes | Source | |
| Qwen 14B | - | 83.50% | inferred family alias from qwen-2.5-14b-instruct (score=0.3060; benches=16) | Yes | Source | |
| Gemini 1.5 Pro 001 | 23 May 2024 | 84.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01 Aug 2024 | 84.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27 Aug 2024 | 84.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini Robotics ER 1.5 Preview | 25 Sept 2025 | 84.10% | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Yes | Source | |
| LearnLM 1.5 Pro Experimental | 19 Nov 2024 | 84.10% | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Yes | Source | |
| Qwen 7B | - | 84.80% | inferred family alias from qwen-2.5-7b-instruct (score=0.3083; benches=14) | Yes | Source | |
| Granite 4.1 8B | 29 Apr 2026 | 85.37% | pass@1 | Yes | Source | |
| Grok 2 Mini | 13 Aug 2024 | 85.70% | - | Yes | Source | |
| Qwen 2 Math 72B | - | 86% | inferred high-confidence family alias from qwen2-72b-instruct (score=0.4667; benches=17) | Yes | Source | |
| Qwen 2 Math RM 72B | - | 86% | inferred family alias from qwen2-72b-instruct (score=0.3917; benches=17) | Yes | Source | |
| Qwen 72B | - | 86.60% | inferred family alias from qwen-2.5-72b-instruct (score=0.3060; benches=14) | Yes | Source | |
| GPT 4 Turbo (2023-11-06) | 06 Nov 2023 | 87.10% | inferred version-family alias from gpt-4-turbo-2024-04-09 | Yes | Source | |
| GPT 4o Mini Audio Preview | 17 Dec 2024 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Realtime Preview | 17 Dec 2024 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Search Preview | 11 Mar 2025 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-12-15) | 15 Dec 2025 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-03-20) | 20 Mar 2025 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-12-15) | 15 Dec 2025 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-03-20) | 20 Mar 2025 | 87.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4.5 | 27 Feb 2025 | 88% | - | Yes | Source | |
| Llama 2 70B Chat | 20 Jun 2023 | 88.40% | inferred family alias from llama-3.3-70b-instruct (score=0.3129; benches=9) | Yes | Source | |
| Grok 2 | 13 Aug 2024 | 88.40% | - | Yes | Source | |
| Granite 4.1 30B | 29 Apr 2026 | 88.41% | pass@1 | Yes | Source | |
| LongCat Flash Chat | - | 88.41% | inferred high-confidence family alias from longcat-flash-chat (score=0.4667; benches=16) | Yes | Source | |
| DeepSeek V2.5 (2024-09-05) | 05 Sept 2024 | 89% | inferred alias from deepseek-v2.5 | Yes | Source | |
| DeepSeek V2.5 (2024-12-10) | 10 Dec 2024 | 89% | inferred alias from deepseek-v2.5 | Yes | Source | |
| Gemini Diffusion | 20 May 2025 | 89.60% | Pass@1 | Yes | Source | |
| Granite 3.0 8B Instruct | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.1 8B Instruct | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.2 8B Instruct | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4911; benches=14) | Yes | Source | |
| Granite 3.2 8B Instruct Preview | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.4687; benches=14) | Yes | Source | |
| Granite 3.3 2B Instruct | 16 Apr 2025 | 89.73% | inferred family alias from granite-3.3-8b-instruct (score=0.3627; benches=14) | Yes | Source | |
| Granite 3.3 8B Instruct | 16 Apr 2025 | 89.73% | - | Yes | Source | |
| Granite Guardian 3.0 8B | - | 89.73% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Guardian 3.1 8B | - | 89.73% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Guardian 3.3 8B | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Yes | Source | |
| Granite Speech 3.2 8B | - | 89.73% | inferred family alias from granite-3.3-8b-instruct (score=0.4062; benches=14) | Yes | Source | |
| Granite Speech 3.3 8B | - | 89.73% | inferred high-confidence family alias from granite-3.3-8b-instruct (score=0.5071; benches=14) | Yes | Source | |
| GPT 4o (2024-05-13) | 13 May 2024 | 90.20% | - | Yes | Source | |
| Qwen 2.5 Coder 32B Instruct | - | 91.50% | inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4641; benches=28) | Yes | Source | |
| Qwen 2.5 VL 32B Instruct | 24 Mar 2025 | 91.50% | - | Yes | Source | |
| Qwen 2.5 VL 3B Instruct | - | 91.50% | inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4914; benches=28) | Yes | Source | |
| Mistral Large 2.1 | 18 Nov 2024 | 92% | inferred version-family alias from mistral-large-2-2407 | Yes | Source | |
| Mistral Moderation 2 | 17 Mar 2026 | 92% | manual fallback alias from mistral-large-2-2407 | Yes | Source | |
| Mistral OCR 2 | 22 May 2025 | 92% | inferred family alias from mistral-large-2-2407 (score=0.3100; benches=5) | Yes | Source | |
| Voxtral Mini Transcribe 2 | 04 Feb 2026 | 92% | manual fallback alias from mistral-large-2-2407 | Yes | Source | |
| o1 mini | 12 Sept 2024 | 92.40% | - | Yes | Source | |
| Mistral Small 3.2 | 20 Jun 2025 | 92.90% | Pass@5 | Yes | Source |
