Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Ernie 4.5 21B A3B | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 21B A3B Thinking | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 300B A47B | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 Turbo | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 VL 28B A3B | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Ernie 4.5 VL 424B A47B | - | 12.40% | inferred version-family alias from ernie-4.5 | Yes | Source | |
| Grok 0 | - | 15.40% | 4 Shot | Yes | Source | |
| Grok 1 | 03 Nov 2023 | 23.90% | 4 Shot | Yes | Source | |
| Gemini 1.0 Nano | 06 Dec 2023 | 32.60% | inferred modality/version alias from gemini-1.0-pro | No | Source | |
| Gemini 1.0 Pro | 06 Dec 2023 | 32.60% | - | No | Source | |
| Gemini 1.0 Pro Vision 001 | 15 Feb 2024 | 32.60% | inferred modality/version alias from gemini-1.0-pro | No | Source | |
| Kimi K2 (2025-07-11) | 11 Jul 2025 | 40.20% | EM | Yes | Source | |
| GPT 4 32K 0613 | 13 Jun 2023 | 42% | inferred high-confidence family alias from gpt-4-0613 (score=0.4899; benches=12) | Yes | Source | |
| GPT 3.5 Turbo 16K 0613 | 13 Jun 2023 | 43.10% | inferred family alias from gpt-3.5-turbo-0125 (score=0.4244; benches=8) | No | Source | |
| GPT 3.5 Turbo (2023-11-06) | 28 Sept 2023 | 43.10% | inferred modality/version alias from gpt-3.5-turbo-0125 | No | Source | |
| GPT 3.5 Turbo Instruct | 06 Nov 2023 | 43.10% | inferred high-confidence family alias from gpt-3.5-turbo-0125 (score=0.5539; benches=8) | No | Source | |
| Pixtral 12B | 17 Sept 2024 | 48.10% | inferred version-family alias from pixtral-12b-2409 | Yes | Source | |
| Phi 3 Mini 128K Instruct | - | 48.50% | inferred family alias from phi-3.5-mini-instruct (score=0.3533; benches=31) | Yes | Source | |
| Phi 3.5 mini instruct | 23 Aug 2024 | 48.50% | - | Yes | Source | |
| Qwen 2 Audio 7B | - | 49.60% | inferred modality/version alias from qwen2-7b-instruct | Yes | Source | |
| Qwen 2 Math 7B | - | 49.60% | inferred high-confidence family alias from qwen2-7b-instruct (score=0.4706; benches=14) | Yes | Source | |
| Llama 4 Scout | 05 Apr 2025 | 50.30% | - | Yes | Source | |
| Grok 1.5 | 28 Mar 2024 | 50.60% | - | Yes | Source | |
| Llama 3.2 11B Vision Instruct | - | 51.90% | inferred high-confidence family alias from llama-3.2-11b-instruct (score=0.5873; benches=11) | Yes | Source | |
| Llama 3.2 1B Instruct | 25 Sept 2024 | 51.90% | inferred family alias from llama-3.2-11b-instruct (score=0.4200; benches=11) | Yes | Source | |
| Gemini 1.0 Ultra | 06 Dec 2023 | 53.20% | - | No | Source | |
| Gemini 1.5 Flash 8B | 15 Mar 2024 | 58.70% | - | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-08-27) | 27 Aug 2024 | 58.70% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-09-24) | 24 Sept 2024 | 58.70% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| Phi 3.5 MoE instruct | 23 Aug 2024 | 59.50% | - | Yes | Source | |
| Qwen 2 Math 72B | - | 59.70% | inferred high-confidence family alias from qwen2-72b-instruct (score=0.4667; benches=17) | Yes | Source | |
| Qwen 2 Math RM 72B | - | 59.70% | inferred family alias from qwen2-72b-instruct (score=0.3917; benches=17) | Yes | Source | |
| Llama 4 Maverick | 05 Apr 2025 | 61.20% | - | Yes | Source | |
| Phi 4 Mini | 01 Feb 2025 | 64% | - | Yes | Source | |
| Llama 3.2 90B Vision Instruct | - | 68% | inferred high-confidence family alias from llama-3.2-90b-instruct (score=0.5873; benches=13) | Yes | Source | |
| Mistral Small 3.2 | 20 Jun 2025 | 69.42% | 5 Shot CoT | Yes | Source | |
| GPT 4o Mini Audio Preview | 17 Dec 2024 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Realtime Preview | 17 Dec 2024 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Search Preview | 11 Mar 2025 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-12-15) | 15 Dec 2025 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-03-20) | 20 Mar 2025 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-12-15) | 15 Dec 2025 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-03-20) | 20 Mar 2025 | 70.20% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| Qwen 2.5 Coder 3B | - | 71.50% | inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45) | Yes | Source | |
| Qwen 2.5 Coder 7B | - | 71.50% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B | - | 71.50% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B PRM800K | - | 71.50% | inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45) | Yes | Source | |
| Qwen 2.5 Math PRM 7B | - | 71.50% | inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 3B | - | 71.50% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 7B | - | 71.50% | - | Yes | Source | |
| Qwen 3 235B A22B | - | 71.84% | - | Yes | Source | |
| GPT 4 Turbo (2023-11-06) | 06 Nov 2023 | 72.60% | inferred version-family alias from gpt-4-turbo-2024-04-09 | Yes | Source | |
| Grok 2 Mini | 13 Aug 2024 | 73% | - | Yes | Source | |
| DeepSeek V2.5 (2024-09-05) | 05 Sept 2024 | 74.70% | inferred alias from deepseek-v2.5 | Yes | Source | |
| DeepSeek V2.5 (2024-12-10) | 10 Dec 2024 | 74.70% | inferred alias from deepseek-v2.5 | Yes | Source | |
| Qwen 7B | - | 75.50% | inferred family alias from qwen-2.5-7b-instruct (score=0.3083; benches=14) | Yes | Source | |
| Grok 2 | 13 Aug 2024 | 76.10% | - | Yes | Source | |
| GPT 4o (2024-05-13) | 13 May 2024 | 76.60% | - | Yes | Source | |
| Llama 2 70B Chat | 20 Jun 2023 | 77% | inferred family alias from llama-3.3-70b-instruct (score=0.3129; benches=9) | Yes | Source | |
| Gemini 1.5 Flash 001 | 23 May 2024 | 77.90% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash Preview | 14 May 2024 | 77.90% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Qwen 14B | - | 80% | inferred family alias from qwen-2.5-14b-instruct (score=0.3060; benches=16) | Yes | Source | |
| Phi 1 | - | 80.40% | inferred family alias from phi-4 (score=0.3100; benches=13) | Yes | Source | |
| Phi 2 | - | 80.40% | inferred family alias from phi-4 (score=0.3100; benches=13) | Yes | Source | |
| Phi 4 | 12 Dec 2024 | 80.40% | - | Yes | Source | |
| Qwen 2.5 Coder 32B Instruct | - | 82.20% | inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4641; benches=28) | Yes | Source | |
| Qwen 2.5 VL 32B Instruct | 24 Mar 2025 | 82.20% | - | Yes | Source | |
| Qwen 2.5 VL 3B Instruct | - | 82.20% | inferred high-confidence family alias from qwen2.5-vl-32b (score=0.4914; benches=28) | Yes | Source | |
| Ministral 3.0 3B | 02 Dec 2025 | 83% | Majority @ 1 | Yes | Source | |
| Qwen 72B | - | 83.10% | inferred family alias from qwen-2.5-72b-instruct (score=0.3060; benches=14) | Yes | Source | |
| o1 preview | 12 Sept 2024 | 85.50% | - | Yes | Source | |
| Gemini 1.5 Pro 001 | 23 May 2024 | 86.50% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01 Aug 2024 | 86.50% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27 Aug 2024 | 86.50% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini Robotics ER 1.5 Preview | 25 Sept 2025 | 86.50% | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Yes | Source | |
| LearnLM 1.5 Pro Experimental | 19 Nov 2024 | 86.50% | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Yes | Source | |
| Gemini 2.0 Flash Lite | 05 Feb 2025 | 86.80% | - | Yes | Source | |
| Ministral 3.0 8B | 02 Dec 2025 | 87.60% | Majority @ 1 | Yes | Source | |
| Gemini 2.0 Flash | 05 Feb 2025 | 89.70% | - | Yes | Source | |
| Gemini 2.0 Flash Exp | - | 89.70% | inferred alias from gemini-2.0-flash | Yes | Source | |
| Gemini 2.0 Pro Exp (2025-02-05) | 05 Feb 2025 | 89.70% | inferred modality/version alias from gemini-2.0-flash | Yes | Source | |
| LearnLM 2.0 Flash Experimental | 17 Apr 2025 | 89.70% | inferred family alias from gemini-2.0-flash (score=0.3700; benches=13) | Yes | Source | |
| Ministral 3.0 14B | 02 Dec 2025 | 90.40% | Majority @ 1 | Yes | Source | |
| o3 mini | 30 Jan 2025 | 97.90% | - | Yes | Source |
