ChartQA

Overview

Type: percentage

Recorded Results

Average Score

85.69%

Score Range

76.10% - 90%

Leading Model (lowest score)

76.10% - Grok 1.5V

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
SpaceXAI	Grok 1.5V	12 Apr 2024	76.10%	-	Yes	Source
DeepSeek	DeepSeek VL2 Tiny	13 Dec 2024	81%	-	Yes	Source
Microsoft	Phi 4 multimodal instruct	01 Feb 2025	81.40%	-	Yes	Source
Microsoft	Phi 3 Vision 128K Instruct	-	81.80%	inferred family alias from phi-3.5-vision-instruct (score=0.3495; benches=9)	Yes	Source
Microsoft	Phi 3.5 vision instruct	23 Aug 2024	81.80%	-	Yes	Source
Mistral	Pixtral 12B	17 Sept 2024	81.80%	inferred version-family alias from pixtral-12b-2409	Yes	Source
Meta	Llama 3.2 11B Vision Instruct	-	83.40%	inferred high-confidence family alias from llama-3.2-11b-instruct (score=0.5873; benches=11)	Yes	Source
Meta	Llama 3.2 1B Instruct	25 Sept 2024	83.40%	inferred family alias from llama-3.2-11b-instruct (score=0.4200; benches=11)	Yes	Source
DeepSeek	DeepSeek VL2 Small	13 Dec 2024	84.50%	-	Yes	Source
Qwen	Qwen 2.5 Coder 3B	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.3000; benches=45)	Yes	Source
Qwen	Qwen 2.5 Coder 7B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4700; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4767; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math 7B PRM800K	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.3696; benches=45)	Yes	Source
Qwen	Qwen 2.5 Math PRM 7B	-	85.30%	inferred family alias from qwen2.5-omni-7b (score=0.4092; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 3B	-	85.30%	inferred high-confidence family alias from qwen2.5-omni-7b (score=0.4933; benches=45)	Yes	Source
Qwen	Qwen 2.5 Omni 7B	-	85.30%	-	Yes	Source
Meta	Llama 3.2 90B Vision Instruct	-	85.50%	inferred high-confidence family alias from llama-3.2-90b-instruct (score=0.5873; benches=13)	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	85.70%	-	Yes	Source
OpenAI	GPT 4o Audio (2025-06-03)	03 Jun 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2024-10-01)	01 Oct 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2024-12-17)	17 Dec 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	85.70%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
DeepSeek	DeepSeek VL2	13 Dec 2024	86%	-	Yes	Source
Qwen	Qwen 2.5 0.5B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 1.5B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3131; benches=32)	Yes	Source
Qwen	Qwen 2.5 3B	-	87.30%	inferred family alias from qwen2.5-vl-7b (score=0.3531; benches=32)	Yes	Source
Qwen	Qwen 2.5 VL 7B Instruct	-	87.30%	-	Yes	Source
Mistral	Mistral Small 3.2	20 Jun 2025	87.40%	-	Yes	Source
Mistral	Pixtral Large	18 Nov 2024	88.10%	-	Yes	Source
Qwen	Qwen 2 VL 2B	-	88.30%	inferred family alias from qwen2-vl-72b (score=0.4083; benches=15)	Yes	Source
Qwen	Qwen 2 VL 72B	-	88.30%	-	Yes	Source
Meta	Llama 4 Scout	05 Apr 2025	88.80%	-	Yes	Source
Qwen	Qwen 2.5 Math 72B	-	89.50%	inferred high-confidence family alias from qwen2.5-vl-72b (score=0.4700; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math PRM 72B	-	89.50%	inferred family alias from qwen2.5-vl-72b (score=0.4050; benches=30)	Yes	Source
Qwen	Qwen 2.5 Math RM 72B	-	89.50%	inferred family alias from qwen2.5-vl-72b (score=0.4092; benches=30)	Yes	Source
Qwen	Qwen 2.5 VL 72B Instruct	26 Jan 2025	89.50%	-	Yes	Source
Meta	Llama 4 Maverick	05 Apr 2025	90%	-	Yes	Source