Bird-SQL (dev) Benchmark

Bird-SQL (dev) Benchmark | Phaseo

Models Using This Benchmark

Organisation	Model	Reported	Top Score	Info	Self Reported	Source
Google	Gemini 2.0 Flash Lite	05 Feb 2025	57.40%	-	Yes	Source
Google	Gemini 2.0 Flash	05 Feb 2025	56.90%	-	Yes	Source
Google	Gemini 2.0 Flash Exp	-	56.90%	inferred alias from gemini-2.0-flash	Yes	Source
Google	Gemini 2.0 Pro Exp (2025-02-05)	05 Feb 2025	56.90%	inferred modality/version alias from gemini-2.0-flash	Yes	Source
Google	LearnLM 2.0 Flash Experimental	17 Apr 2025	56.90%	inferred family alias from gemini-2.0-flash (score=0.3700; benches=13)	Yes	Source
Nvidia	Nemotron 3 Super	11 Mar 2026	41.80%	-	Yes	Source

Bird-SQL (dev)