Model

Claude Sonnet 5.5

Anthropic · closed weights

anthropic.com

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
CritPt31.4accuracyN/AIndependentlowepoch.ai
GPQA Diamond95.6accuracyN/AIndependenthighepoch.ai
HLE46.1accuracyN/AIndependentlowepoch.ai
SimpleQA Verified46.5accuracyN/AIndependenthighepoch.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
SciCode61.0scoreN/AIndependentmediumartificialanalysis.ai

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
Argo-Bench51.8scoreN/AIndependentmediumarxiv.org
Autonomous Science Bench11.1success_rateN/AIndependentmediumarxiv.org
FDE-Gym0.5scoreN/AIndependentmediumarxiv.org
ToolBottleneckBench94.4success_ratetoolbottleneckbenchIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
GDP.pdf31.4gdp.pdf_scoreN/AIndependentmediumsurgehq.ai
VELD-QA74.9accuracytop-3 rag (colpali)Independentmediumarxiv.org

Reproduced by the community

Loading community runs…