GPQA Diamond

New Release|Introducing AI Stats Gateway|Read the docs

New Release

New Release|Introducing AI Stats Gateway|Read the docs

New Release

GPQA Diamond - Benchmark Leaderboard & Model Performance | AI Stats

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Google	Gemini 3.1 Pro Preview	19 Feb 2026	0.94	No Tools	Yes	-
OpenAI	GPT 5.2 Pro	11 Dec 2025	0.93	No Tools	Yes	Source
OpenAI	GPT 5.2	11 Dec 2025	0.92	No Tools	Yes	Source
xAI	Grok 4 Heavy	10 Jul 2025	0.89	-	Yes	Source
OpenAI	o3 Preview	20 Dec 2024	0.88	-	Yes	Source
xAI	Grok 4	10 Jul 2025	0.88	No Tools	Yes	Source
OpenAI	GPT 5	07 Aug 2025	0.87	Pass @ 1	Yes	Source
Anthropic	Claude Opus 4.5	24 Nov 2025	0.87	Avg@5, 64k Thinking	Yes	Source
Google	Gemini 2.5 Pro Preview (2025-06-05)	05 Jun 2025	0.86	Single Attempt	Yes	Source
DeepSeek	DeepSeek V3.2 Speciale	01 Dec 2025	0.86	-	Yes	Source
Anthropic	Claude 3.7 Sonnet	24 Feb 2025	0.85	-	Yes	Source
xAI	Grok 3 Beta	19 Feb 2025	0.85	Think, Cons@64	Yes	Source
OpenAI	o3 Pro	10 Jun 2025	0.84	-	Yes	Source
xAI	Grok 3 Mini Beta	19 Feb 2025	0.84	Think, Cons@64	Yes	Source
Anthropic	Claude Sonnet 4	21 May 2025	0.84	-	Yes	-
Anthropic	Claude Opus 4	21 May 2025	0.83	-	Yes	-
OpenAI	o3	16 Apr 2025	0.83	-	Yes	Source
Google	Gemini 2.5 Pro Preview (2025-05-06)	06 May 2025	0.83	Pass@1	Yes	Source
Google	Gemini 2.5 Flash Preview (2025-05-20)	20 May 2025	0.83	Pass@1	Yes	Source
OpenAI	GPT 5 Mini	07 Aug 2025	0.82	High Reasoning Effort, No Tools	Yes	Source
OpenAI	o4 Mini	16 Apr 2025	0.81	-	Yes	Source
Amazon	Nova 2 Pro	02 Dec 2025	0.81	-	Yes	Source
DeepSeek	Deepseek R1 (2025-05-28)	28 May 2025	0.81	-	Yes	Source
OpenAI	GPT OSS 120b	05 Aug 2025	0.81	High Reasoning Effort, With Tools	Yes	Source
Anthropic	Claude Opus 4.1	05 Aug 2025	0.81	-	Yes	Source
xAI	Grok 3 Mini	18 Apr 2025	0.80	High Reasoning Effort	Yes	Source
OpenAI	o3 mini	30 Jan 2025	0.80	High Reasoning Effort	Yes	-
Amazon	Nova 2 Lite	02 Dec 2025	0.80	-	Yes	Source
xAI	Grok 3	18 Apr 2025	0.79	-	Yes	Source
OpenAI	o1 pro	19 Mar 2025	0.79	-	Yes	Source
Google	Gemini 2.0 Flash	05 Feb 2025	0.78	Single Attempt	Yes	Source
Google	Gemini 2.5 Flash Preview (2025-04-17)	17 Apr 2025	0.78	Thinking, Single Attempt	Yes	Source
OpenAI	o1	17 Dec 2024	0.78	-	Yes	Source
Nvidia	Llama 3.1 Nemotron Ultra 253B v1	07 Apr 2025	0.76	-	Yes	Source
LG	EXAONE 4.0 32B	15 Jul 2025	0.75	Reasoning	Yes	Source
OpenAI	GPT OSS 20b	05 Aug 2025	0.74	High Reasoning Effort, With Tools	Yes	Source
OpenAI	o1 preview	12 Sept 2024	0.73	-	Yes	Source
DeepSeek	Deepseek R1 (2025-01-20)	20 Jan 2025	0.71	-	No	Source
OpenAI	GPT 4.5	27 Feb 2025	0.71	-	Yes	-
OpenAI	GPT 5 Nano	07 Aug 2025	0.71	High Reasoning Effort, No Tools	Yes	Source
Microsoft	Phi 4 Reasoning Plus	30 Apr 2025	0.69	-	Yes	Source
DeepSeek	DeepSeek V3 (2025-03-24)	25 Mar 2025	0.68	-	Yes	Source
Anthropic	Claude 3.5 Sonnet (2024-06-20)	21 Jun 2024	0.67	-	Yes	Source
Nvidia	Llama 3.3 Nemotron Super 49B v1	18 Mar 2025	0.67	-	Yes	Source
Google	Gemini 2.5 Flash Lite Preview	17 Jun 2025	0.67	Thinking	Yes	Source
OpenAI	GPT 4.1	14 Apr 2025	0.66	-	Yes	Source
Microsoft	Phi 4 Reasoning	30 Apr 2025	0.66	-	Yes	Source
OpenAI	GPT 4.1 Mini	14 Apr 2025	0.65	-	Yes	Source
Anthropic	Claude 3.5 Sonnet (2024-10-22)	22 Oct 2024	0.65	-	Yes	-
OpenAI	o1 mini	12 Sept 2024	0.60	-	Yes	Source
Amazon	Nova Premier	30 Apr 2025	0.57	-	Yes	-
Microsoft	Phi 4	12 Dec 2024	0.56	-	Yes	Source
xAI	Grok 2	13 Aug 2024	0.56	-	Yes	Source
Nvidia	Llama 3.1 Nemotron Nano 8B V1	18 Mar 2025	0.54	-	Yes	Source
Microsoft	Phi 4 Mini Reasoning	30 Apr 2025	0.52	-	Yes	Source
LG	EXAONE 4.0 1.2B	15 Jul 2025	0.52	Reasoning	Yes	Source
xAI	Grok 2 Mini	13 Aug 2024	0.51	-	Yes	Source
Meta	Llama 3.1 405B Instruct	23 Jul 2024	0.51	-	Yes	Source
Meta	Llama 3.3 70B Instruct	06 Dec 2024	0.51	-	Yes	Source
Anthropic	Claude 3 Opus	04 Mar 2024	0.50	-	Yes	Source
OpenAI	GPT 4.1 Nano	14 Apr 2025	0.50	-	Yes	Source
Amazon	Nova Pro 1.0	04 Dec 2024	0.47	-	Yes	Source
Mistral	Mistral Small 3.2	20 Jun 2025	0.46	-	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	0.46	-	Yes	Source
Google	Gemma 3 27B	12 Mar 2025	0.42	-	Yes	Source
Amazon	Nova Lite 1.0	04 Dec 2024	0.42	-	Yes	Source
Meta	Llama 3.1 70B Instruct	23 Jul 2024	0.42	-	Yes	Source
Anthropic	Claude 3.5 Haiku	04 Nov 2024	0.42	-	Yes	Source
Google	Gemma 3 12B	12 Mar 2025	0.41	-	Yes	Source
Anthropic	Claude 3 Sonnet	04 Mar 2024	0.40	-	Yes	Source
Google	Gemini Diffusion	20 May 2025	0.40	Pass@1	Yes	Source
OpenAI	GPT 4o Mini (2024-07-18)	18 Jul 2024	0.40	-	Yes	Source
Amazon	Nova Micro 1.0	04 Dec 2024	0.40	-	Yes	Source
ai21	Jamba Large 1.6	06 Mar 2025	0.39	-	No	Source
ai21	Jamba Large 1.5	22 Aug 2024	0.37	-	Yes	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	0.37	-	Yes	Source
xAI	Grok 1.5	28 Mar 2024	0.36	-	Yes	Source
Google	Gemini 1.0 Ultra	06 Dec 2023	0.36	-	Yes	Source
OpenAI	GPT 4 (2023-03-14)	14 Mar 2023	0.36	-	Yes	Source
Anthropic	Claude 3 Haiku	13 Mar 2024	0.33	-	Yes	Source
Meta	Llama 3.2 3B Instruct	25 Sept 2024	0.33	-	Yes	Source
ai21	Jamba Mini 1.5	22 Aug 2024	0.32	-	Yes	Source
Google	Gemma 3 4B	12 Mar 2025	0.31	-	Yes	Source
OpenAI	GPT 3.5 Turbo	21 Mar 2023	0.31	-	No	-
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	0.30	-	Yes	Source
Meta	Llama 3.1 8B Instruct	23 Jul 2024	0.30	-	Yes	Source
ai21	Jamba Mini 1.6	06 Mar 2025	0.30	-	No	Source
Google	Gemini 1.0 Pro	06 Dec 2023	0.28	-	No	-
Google	Gemma 3 1B	12 Mar 2025	0.19	-	Yes	Source

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Google	Gemini 3.1 Pro Preview	19 Feb 2026	0.94	No Tools	Yes	-
OpenAI	GPT 5.2 Pro	11 Dec 2025	0.93	No Tools	Yes	Source
OpenAI	GPT 5.2	11 Dec 2025	0.92	No Tools	Yes	Source
xAI	Grok 4 Heavy	10 Jul 2025	0.89	-	Yes	Source
OpenAI	o3 Preview	20 Dec 2024	0.88	-	Yes	Source
xAI	Grok 4	10 Jul 2025	0.88	No Tools	Yes	Source
OpenAI	GPT 5	07 Aug 2025	0.87	Pass @ 1	Yes	Source
Anthropic	Claude Opus 4.5	24 Nov 2025	0.87	Avg@5, 64k Thinking	Yes	Source
Google	Gemini 2.5 Pro Preview (2025-06-05)	05 Jun 2025	0.86	Single Attempt	Yes	Source
DeepSeek	DeepSeek V3.2 Speciale	01 Dec 2025	0.86	-	Yes	Source
Anthropic	Claude 3.7 Sonnet	24 Feb 2025	0.85	-	Yes	Source
xAI	Grok 3 Beta	19 Feb 2025	0.85	Think, Cons@64	Yes	Source
OpenAI	o3 Pro	10 Jun 2025	0.84	-	Yes	Source
xAI	Grok 3 Mini Beta	19 Feb 2025	0.84	Think, Cons@64	Yes	Source
Anthropic	Claude Sonnet 4	21 May 2025	0.84	-	Yes	-
Anthropic	Claude Opus 4	21 May 2025	0.83	-	Yes	-
OpenAI	o3	16 Apr 2025	0.83	-	Yes	Source
Google	Gemini 2.5 Pro Preview (2025-05-06)	06 May 2025	0.83	Pass@1	Yes	Source
Google	Gemini 2.5 Flash Preview (2025-05-20)	20 May 2025	0.83	Pass@1	Yes	Source
OpenAI	GPT 5 Mini	07 Aug 2025	0.82	High Reasoning Effort, No Tools	Yes	Source
OpenAI	o4 Mini	16 Apr 2025	0.81	-	Yes	Source
Amazon	Nova 2 Pro	02 Dec 2025	0.81	-	Yes	Source
DeepSeek	Deepseek R1 (2025-05-28)	28 May 2025	0.81	-	Yes	Source
OpenAI	GPT OSS 120b	05 Aug 2025	0.81	High Reasoning Effort, With Tools	Yes	Source
Anthropic	Claude Opus 4.1	05 Aug 2025	0.81	-	Yes	Source
xAI	Grok 3 Mini	18 Apr 2025	0.80	High Reasoning Effort	Yes	Source
OpenAI	o3 mini	30 Jan 2025	0.80	High Reasoning Effort	Yes	-
Amazon	Nova 2 Lite	02 Dec 2025	0.80	-	Yes	Source
xAI	Grok 3	18 Apr 2025	0.79	-	Yes	Source
OpenAI	o1 pro	19 Mar 2025	0.79	-	Yes	Source
Google	Gemini 2.0 Flash	05 Feb 2025	0.78	Single Attempt	Yes	Source
Google	Gemini 2.5 Flash Preview (2025-04-17)	17 Apr 2025	0.78	Thinking, Single Attempt	Yes	Source
OpenAI	o1	17 Dec 2024	0.78	-	Yes	Source
Nvidia	Llama 3.1 Nemotron Ultra 253B v1	07 Apr 2025	0.76	-	Yes	Source
LG	EXAONE 4.0 32B	15 Jul 2025	0.75	Reasoning	Yes	Source
OpenAI	GPT OSS 20b	05 Aug 2025	0.74	High Reasoning Effort, With Tools	Yes	Source
OpenAI	o1 preview	12 Sept 2024	0.73	-	Yes	Source
DeepSeek	Deepseek R1 (2025-01-20)	20 Jan 2025	0.71	-	No	Source
OpenAI	GPT 4.5	27 Feb 2025	0.71	-	Yes	-
OpenAI	GPT 5 Nano	07 Aug 2025	0.71	High Reasoning Effort, No Tools	Yes	Source
Microsoft	Phi 4 Reasoning Plus	30 Apr 2025	0.69	-	Yes	Source
DeepSeek	DeepSeek V3 (2025-03-24)	25 Mar 2025	0.68	-	Yes	Source
Anthropic	Claude 3.5 Sonnet (2024-06-20)	21 Jun 2024	0.67	-	Yes	Source
Nvidia	Llama 3.3 Nemotron Super 49B v1	18 Mar 2025	0.67	-	Yes	Source
Google	Gemini 2.5 Flash Lite Preview	17 Jun 2025	0.67	Thinking	Yes	Source
OpenAI	GPT 4.1	14 Apr 2025	0.66	-	Yes	Source
Microsoft	Phi 4 Reasoning	30 Apr 2025	0.66	-	Yes	Source
OpenAI	GPT 4.1 Mini	14 Apr 2025	0.65	-	Yes	Source
Anthropic	Claude 3.5 Sonnet (2024-10-22)	22 Oct 2024	0.65	-	Yes	-
OpenAI	o1 mini	12 Sept 2024	0.60	-	Yes	Source
Amazon	Nova Premier	30 Apr 2025	0.57	-	Yes	-
Microsoft	Phi 4	12 Dec 2024	0.56	-	Yes	Source
xAI	Grok 2	13 Aug 2024	0.56	-	Yes	Source
Nvidia	Llama 3.1 Nemotron Nano 8B V1	18 Mar 2025	0.54	-	Yes	Source
Microsoft	Phi 4 Mini Reasoning	30 Apr 2025	0.52	-	Yes	Source
LG	EXAONE 4.0 1.2B	15 Jul 2025	0.52	Reasoning	Yes	Source
xAI	Grok 2 Mini	13 Aug 2024	0.51	-	Yes	Source
Meta	Llama 3.1 405B Instruct	23 Jul 2024	0.51	-	Yes	Source
Meta	Llama 3.3 70B Instruct	06 Dec 2024	0.51	-	Yes	Source
Anthropic	Claude 3 Opus	04 Mar 2024	0.50	-	Yes	Source
OpenAI	GPT 4.1 Nano	14 Apr 2025	0.50	-	Yes	Source
Amazon	Nova Pro 1.0	04 Dec 2024	0.47	-	Yes	Source
Mistral	Mistral Small 3.2	20 Jun 2025	0.46	-	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	0.46	-	Yes	Source
Google	Gemma 3 27B	12 Mar 2025	0.42	-	Yes	Source
Amazon	Nova Lite 1.0	04 Dec 2024	0.42	-	Yes	Source
Meta	Llama 3.1 70B Instruct	23 Jul 2024	0.42	-	Yes	Source
Anthropic	Claude 3.5 Haiku	04 Nov 2024	0.42	-	Yes	Source
Google	Gemma 3 12B	12 Mar 2025	0.41	-	Yes	Source
Anthropic	Claude 3 Sonnet	04 Mar 2024	0.40	-	Yes	Source
Google	Gemini Diffusion	20 May 2025	0.40	Pass@1	Yes	Source
OpenAI	GPT 4o Mini (2024-07-18)	18 Jul 2024	0.40	-	Yes	Source
Amazon	Nova Micro 1.0	04 Dec 2024	0.40	-	Yes	Source
ai21	Jamba Large 1.6	06 Mar 2025	0.39	-	No	Source
ai21	Jamba Large 1.5	22 Aug 2024	0.37	-	Yes	Source
Microsoft	Phi 3.5 MoE instruct	23 Aug 2024	0.37	-	Yes	Source
xAI	Grok 1.5	28 Mar 2024	0.36	-	Yes	Source
Google	Gemini 1.0 Ultra	06 Dec 2023	0.36	-	Yes	Source
OpenAI	GPT 4 (2023-03-14)	14 Mar 2023	0.36	-	Yes	Source
Anthropic	Claude 3 Haiku	13 Mar 2024	0.33	-	Yes	Source
Meta	Llama 3.2 3B Instruct	25 Sept 2024	0.33	-	Yes	Source
ai21	Jamba Mini 1.5	22 Aug 2024	0.32	-	Yes	Source
Google	Gemma 3 4B	12 Mar 2025	0.31	-	Yes	Source
OpenAI	GPT 3.5 Turbo	21 Mar 2023	0.31	-	No	-
Microsoft	Phi 3.5 mini instruct	23 Aug 2024	0.30	-	Yes	Source
Meta	Llama 3.1 8B Instruct	23 Jul 2024	0.30	-	Yes	Source
ai21	Jamba Mini 1.6	06 Mar 2025	0.30	-	No	Source
Google	Gemini 1.0 Pro	06 Dec 2023	0.28	-	No	-
Google	Gemma 3 1B	12 Mar 2025	0.19	-	Yes	Source

GPQA Diamond

Recorded Results

Average Score

Score Range

Leading Model

Models Using This Benchmark

Recorded Results

Average Score

Score Range

Leading Model

Models Using This Benchmark