Tau Bench (Airline)

Overview

Type: percentage

Recorded Results

Average Score

44.51%

Score Range

10% - 62%

Leading Model (lowest score)

10% - EXAONE 4.0 1.2B

Scores Over Time

Individual benchmark scores plotted by date.

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
LG	EXAONE 4.0 1.2B	15 Jul 2025	20.50%	Reasoning	Yes	Source
OpenAI	o3 mini	30 Jan 2025	32.40%	-	Yes	Source
OpenAI	GPT OSS 20b	05 Aug 2025	42.60%	Medium Reasoning Effort	Yes	Source
OpenAI	GPT 4o (2024-08-06)	06 Aug 2024	42.80%	-	Yes	Source
OpenAI	GPT 4o Audio (2025-06-03)	03 Jun 2025	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2024-10-01)	01 Oct 2024	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Audio (2024-12-17)	17 Dec 2024	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2025-06-03)	03 Jun 2025	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Realtime Preview (2024-10-01)	01 Oct 2024	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Search Preview	11 Mar 2025	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe	20 Mar 2025	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
OpenAI	GPT 4o Transcribe Diarize	15 Oct 2025	42.80%	inferred modality/version alias from gpt-4o-2024-08-06	Yes	Source
Qwen	Qwen 3 A235 A22B Instruct 2507	-	44%	-	Yes	Source
Qwen	Qwen 3 Next 80B A3B Instruct	-	44%	TAU1-Airline	Yes	Source
Qwen	Qwen 3 235B A22B Thinking 2507	-	46%	TAU1-Airline	Yes	Source
Qwen	Qwen 3 Next 80B A3B Thinking	-	49%	TAU1-Airline	Yes	Source
OpenAI	GPT OSS 120b	05 Aug 2025	49.20%	High Reasoning Effort	Yes	Source
OpenAI	o4 Mini	16 Apr 2025	49.20%	-	Yes	Source
OpenAI	o4 mini Deep Research	26 Jun 2025	49.20%	inferred modality/version alias from o4-mini	Yes	Source
OpenAI	GPT 4.5	27 Feb 2025	50%	-	Yes	Source
LG	EXAONE 4.0 32B	15 Jul 2025	51.50%	Reasoning	Yes	Source
Anthropic	Claude Opus 4.1	05 Aug 2025	56%	-	Yes	Source
MiniMax	Minimax M1 40K	16 Jun 2025	60%	-	Yes	-
Qwen	Qwen 3 Coder 480B A35B Instruct	-	60%	-	Yes	Source
z.AI	GLM 4.5	28 Jul 2025	60.40%	-	Yes	Source
z.AI	GLM 4.5 Air	28 Jul 2025	60.80%	-	Yes	Source
MiniMax	MiniMax M1 80K	16 Jun 2025	62%	-	Yes	-