Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| GPT 3.5 Turbo 16K 0613 | 13 Jun 2023 | 0% | inferred family alias from gpt-3.5-turbo-0125 (score=0.4244; benches=8) | No | Source | |
| GPT 3.5 Turbo (2023-11-06) | 28 Sept 2023 | 0% | inferred modality/version alias from gpt-3.5-turbo-0125 | No | Source | |
| GPT 3.5 Turbo Instruct | 06 Nov 2023 | 0% | inferred high-confidence family alias from gpt-3.5-turbo-0125 (score=0.5539; benches=8) | No | Source | |
| Phi 3 Vision 128K Instruct | - | 43.90% | inferred family alias from phi-3.5-vision-instruct (score=0.3495; benches=9) | Yes | Source | |
| Phi 3.5 vision instruct | 23 Aug 2024 | 43.90% | - | Yes | Source | |
| Gemini 1.0 Nano | 06 Dec 2023 | 46.60% | inferred modality/version alias from gemini-1.0-pro | No | Source | |
| Gemini 1.0 Pro | 06 Dec 2023 | 46.60% | - | No | Source | |
| Gemini 1.0 Pro Vision 001 | 15 Feb 2024 | 46.60% | inferred modality/version alias from gemini-1.0-pro | No | Source | |
| Llama 3.2 11B Vision Instruct | - | 51.50% | inferred high-confidence family alias from llama-3.2-11b-instruct (score=0.5873; benches=11) | Yes | Source | |
| Llama 3.2 1B Instruct | 25 Sept 2024 | 51.50% | inferred family alias from llama-3.2-11b-instruct (score=0.4200; benches=11) | Yes | Source | |
| Grok 1.5 | 28 Mar 2024 | 52.80% | - | Yes | Source | |
| Grok 1.5V | 12 Apr 2024 | 52.80% | - | Yes | Source | |
| DeepSeek VL2 Tiny | 13 Dec 2024 | 53.60% | - | Yes | Source | |
| Gemini 1.5 Flash 8B | 15 Mar 2024 | 54.70% | - | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-08-27) | 27 Aug 2024 | 54.70% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| Gemini 1.5 Flash 8B Exp (2024-09-24) | 24 Sept 2024 | 54.70% | inferred alias from gemini-1.5-flash-8b | Yes | Source | |
| GPT 4o Mini Audio Preview | 17 Dec 2024 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Realtime Preview | 17 Dec 2024 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Search Preview | 11 Mar 2025 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-12-15) | 15 Dec 2025 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini Transcribe (2025-03-20) | 20 Mar 2025 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-12-15) | 15 Dec 2025 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| GPT 4o Mini TTS (2025-03-20) | 20 Mar 2025 | 56.70% | inferred modality/version alias from gpt-4o-mini-2024-07-18 | Yes | Source | |
| Llama 3.2 90B Vision Instruct | - | 57.30% | inferred high-confidence family alias from llama-3.2-90b-instruct (score=0.5873; benches=13) | Yes | Source | |
| Pixtral 12B | 17 Sept 2024 | 58% | inferred version-family alias from pixtral-12b-2409 | Yes | Source | |
| DeepSeek VL2 Small | 13 Dec 2024 | 60.70% | - | Yes | Source | |
| GPT 4o (2024-08-06) | 06 Aug 2024 | 61.40% | - | Yes | Source | |
| GPT 4o Audio (2025-06-03) | 03 Jun 2025 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Audio (2024-10-01) | 01 Oct 2024 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Audio (2024-12-17) | 17 Dec 2024 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Realtime Preview (2025-06-03) | 03 Jun 2025 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Realtime Preview (2024-10-01) | 01 Oct 2024 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Search Preview | 11 Mar 2025 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Transcribe | 20 Mar 2025 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| GPT 4o Transcribe Diarize | 15 Oct 2025 | 61.40% | inferred modality/version alias from gpt-4o-2024-08-06 | Yes | Source | |
| Phi 4 multimodal instruct | 01 Feb 2025 | 62.40% | - | Yes | Source | |
| DeepSeek VL2 | 13 Dec 2024 | 62.80% | - | Yes | Source | |
| GPT 4o (2024-05-13) | 13 May 2024 | 63.80% | - | Yes | Source | |
| Gemini 1.5 Flash 001 | 23 May 2024 | 65.80% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Gemini 1.5 Flash Preview | 14 May 2024 | 65.80% | inferred alias from gemini-1.5-flash | Yes | Source | |
| Mistral Small 3.2 | 20 Jun 2025 | 67.09% | - | Yes | Source | |
| Qwen 2.5 Coder 3B | - | 67.90% | inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45) | Yes | Source | |
| Qwen 2.5 Coder 7B | - | 67.90% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B | - | 67.90% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45) | Yes | Source | |
| Qwen 2.5 Math 7B PRM800K | - | 67.90% | inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45) | Yes | Source | |
| Qwen 2.5 Math PRM 7B | - | 67.90% | inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 3B | - | 67.90% | inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45) | Yes | Source | |
| Qwen 2.5 Omni 7B | - | 67.90% | - | Yes | Source | |
| Gemini 1.5 Pro 001 | 23 May 2024 | 68.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-01) | 01 Aug 2024 | 68.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini 1.5 Pro Exp (2024-08-27) | 27 Aug 2024 | 68.10% | inferred alias from gemini-1.5-pro | Yes | Source | |
| Gemini Robotics ER 1.5 Preview | 25 Sept 2025 | 68.10% | inferred family alias from gemini-1.5-pro (score=0.3717; benches=23) | Yes | Source | |
| LearnLM 1.5 Pro Experimental | 19 Nov 2024 | 68.10% | inferred family alias from gemini-1.5-pro (score=0.3700; benches=23) | Yes | Source | |
| Grok 2 Mini | 13 Aug 2024 | 68.10% | - | Yes | Source | |
| Grok 2 | 13 Aug 2024 | 69% | - | Yes | Source | |
| Pixtral Large | 18 Nov 2024 | 69.40% | - | Yes | Source | |
| Llama 4 Scout | 05 Apr 2025 | 70.70% | - | Yes | Source | |
| QvQ 72B Preview | - | 71.40% | - | Yes | Source | |
| GPT 4.5 | 27 Feb 2025 | 72.30% | - | Yes | Source | |
| Llama 4 Maverick | 05 Apr 2025 | 73.70% | - | Yes | Source | |
| Kimi K1.5 | 20 Jan 2025 | 74.90% | - | Yes | Source | |
| Command A+ | 20 May 2026 | 80.60% | - | Yes | Source | |
| o4 Mini | 16 Apr 2025 | 84.30% | - | Yes | Source | |
| o4 mini Deep Research | 26 Jun 2025 | 84.30% | inferred modality/version alias from o4-mini | Yes | Source | |
| Seed 2.0 Mini | 14 Feb 2026 | 85.50% | Seed2 official benchmark table | MathVista | Yes | Source | |
| Seed 2.0 Lite | 14 Feb 2026 | 89% | Seed2 official benchmark table | MathVista | Yes | Source | |
| Seed 2.0 Pro | 14 Feb 2026 | 89.80% | Seed2 official benchmark table | MathVista | Yes | Source |
