Leaderboard

Self-reported vs Reproduced

7,285 sourced scores across 1,916 models and 7,569 benchmarks. Nothing here is estimated or interpolated; a missing cell means no sourced number. Community reproductions appear on each benchmark page and in recent runs.

Composite

A weighted average over the ten capability axes. Only shown when coverage is sufficient; otherwise N/A with the coverage reason.

Data as of Oct 22, 2026Default: models with ≥3 axes and ≥8 benchmarks. Sparse rows are muted and tagged low coverage.
#ModelCompositeCoverage & evidenceAxes
1GPT-6 AstraOpenAI88.7

59/668 benchmarks · 8/10 axes

95% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning83.27/60
  • Math100.01/12
  • Coding83.910/62
  • Agentic / Tool Use91.625/101
  • Multimodal82.56/125
  • Instruction Following100.01/13
  • Safety & Alignment68.66/58
  • Abstract Reasoning93.33/7
2Claude Sonnet 5.5Anthropic82.6

8/668 benchmarks · 3/10 axes

82% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning80.93/60
  • Agentic / Tool Use78.14/101
  • Multimodal93.81/125
3Claude Fable 5Anthropic76.0

13/668 benchmarks · 6/10 axes

89% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning81.42/60
  • Coding86.94/62
  • Agentic / Tool Use78.93/101
  • Multimodal41.71/125
  • Safety & Alignment50.02/58
  • Abstract Reasoning92.71/7
4Gemini 3 Flash PreviewGoogle75.5

28/668 benchmarks · 6/10 axes

97% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning86.36/60
  • Coding66.43/62
  • Agentic / Tool Use87.93/101
  • Multimodal79.910/125
  • Safety & Alignment57.55/58
  • Abstract Reasoning62.41/7
5GPT-5.4OpenAI75.4

47/668 benchmarks · 8/10 axes

81% high/med confidence

10% self-reported · 90% independent

  • Knowledge & Reasoning82.711/60
  • Math100.01/12
  • Coding67.59/62
  • Agentic / Tool Use59.69/101
  • Multimodal68.911/125
  • Safety & Alignment80.14/58
  • Abstract Reasoning83.81/7
  • Multilingual75.01/14
6Claude Opus 4.7Anthropic75.3

19/668 benchmarks · 6/10 axes

83% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning72.37/60
  • Coding88.83/62
  • Agentic / Tool Use70.66/101
  • Multimodal58.31/125
  • Safety & Alignment66.71/58
  • Abstract Reasoning84.61/7
7Claude Opus 4.6Anthropic73.3

34/668 benchmarks · 8/10 axes

65% high/med confidence

31% self-reported · 69% independent

  • Knowledge & Reasoning75.55/60
  • Math79.64/12
  • Coding70.39/62
  • Agentic / Tool Use75.36/101
  • Multimodal35.16/125
  • Instruction Following94.41/13
  • Safety & Alignment75.02/58
  • Abstract Reasoning79.51/7
8GPT-5.6 SolOpenAI72.5

106/668 benchmarks · 10/10 axes

98% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning82.513/60
  • Math83.33/12
  • Coding61.018/62
  • Agentic / Tool Use60.038/101
  • Multimodal77.917/125
  • Long Context100.01/2
  • Instruction Following69.22/13
  • Safety & Alignment44.59/58
  • Abstract Reasoning88.92/7
  • Multilingual62.53/14
9GPT-6.1 SolOpenAI72.4

10/668 benchmarks · 6/10 axes

85% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning98.12/60
  • Coding25.01/62
  • Agentic / Tool Use69.94/101
  • Multimodal91.71/125
  • Instruction Following92.31/13
  • Abstract Reasoning99.11/7
10Gemini 3.6 FlashGoogle72.1

15/668 benchmarks · 6/10 axes

89% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning91.22/60
  • Agentic / Tool Use54.63/101
  • Multimodal70.86/125
  • Instruction Following100.01/13
  • Safety & Alignment47.52/58
  • Abstract Reasoning71.41/7
11GPT-5.5OpenAI71.9

51/668 benchmarks · 9/10 axes

93% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning77.36/60
  • Math80.01/12
  • Coding57.49/62
  • Agentic / Tool Use64.914/101
  • Multimodal84.111/125
  • Instruction Following54.22/13
  • Safety & Alignment70.05/58
  • Abstract Reasoning91.51/7
  • Multilingual90.02/14
12Claude Fable 5.1Anthropic71.7

20/668 benchmarks · 7/10 axes

87% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning79.64/60
  • Coding87.54/62
  • Agentic / Tool Use59.35/101
  • Multimodal66.71/125
  • Instruction Following46.21/13
  • Safety & Alignment56.04/58
  • Abstract Reasoning94.91/7
13Claude Opus 5Anthropic71.5

59/668 benchmarks · 8/10 axes

97% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning82.510/60
  • Coding72.713/62
  • Agentic / Tool Use73.021/101
  • Multimodal77.16/125
  • Instruction Following61.51/13
  • Safety & Alignment73.56/58
  • Abstract Reasoning95.71/7
  • Multilingual9.11/14
14Claude Opus 4.5 (2025-11-01)Anthropic69.9

12/668 benchmarks · 5/10 axes

84% high/med confidence

8% self-reported · 92% independent

  • Knowledge & Reasoning76.05/60
  • Coding75.33/62
  • Agentic / Tool Use71.72/101
  • Multimodal65.91/125
  • Abstract Reasoning51.31/7
15Gemini 3.7 FlashGoogle69.0

22/668 benchmarks · 6/10 axes

93% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning68.45/60
  • Coding66.73/62
  • Agentic / Tool Use59.45/101
  • Multimodal74.96/125
  • Safety & Alignment66.02/58
  • Abstract Reasoning89.71/7
16Gemini 3.8 FlashGoogle68.7

51/668 benchmarks · 10/10 axes

95% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning77.76/60
  • Math100.01/12
  • Coding28.33/62
  • Agentic / Tool Use45.119/101
  • Multimodal88.411/125
  • Long Context75.01/2
  • Instruction Following76.91/13
  • Safety & Alignment61.17/58
  • Abstract Reasoning92.71/7
  • Multilingual100.01/14
17Claude Opus 5.5Anthropic68.4

32/668 benchmarks · 8/10 axes

94% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning93.23/60
  • Coding29.22/62
  • Agentic / Tool Use89.217/101
  • Multimodal60.94/125
  • Long Context100.01/2
  • Instruction Following26.92/13
  • Safety & Alignment55.82/58
  • Abstract Reasoning97.91/7
18Claude Sonnet 4.6Anthropic66.1

39/668 benchmarks · 8/10 axes

66% high/med confidence

28% self-reported · 72% independent

  • Knowledge & Reasoning71.17/60
  • Math58.83/12
  • Coding66.27/62
  • Agentic / Tool Use70.19/101
  • Multimodal46.77/125
  • Instruction Following83.31/13
  • Safety & Alignment51.24/58
  • Abstract Reasoning72.61/7
19Qwen2.5-VL-7BAlibaba65.9

25/668 benchmarks · 3/10 axes

100% high/med confidence

0% self-reported · 100% independent

  • Agentic / Tool Use90.91/101
  • Multimodal35.022/125
  • Safety & Alignment37.52/58
20Claude Opus 4.8Anthropic65.8

45/668 benchmarks · 9/10 axes

91% high/med confidence

6% self-reported · 94% independent

  • Knowledge & Reasoning72.76/60
  • Math50.01/12
  • Coding63.913/62
  • Agentic / Tool Use62.014/101
  • Multimodal78.22/125
  • Instruction Following66.72/13
  • Safety & Alignment60.05/58
  • Abstract Reasoning81.61/7
  • Multilingual63.61/14
21GPT-5.6-terraOpenAI64.8

39/668 benchmarks · 9/10 axes

95% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning62.76/60
  • Math50.01/12
  • Coding84.13/62
  • Agentic / Tool Use41.613/101
  • Multimodal59.36/125
  • Instruction Following69.21/13
  • Safety & Alignment52.77/58
  • Abstract Reasoning87.21/7
  • Multilingual90.01/14
22Qwen3-VL-8B-InstructAlibaba64.5

41/668 benchmarks · 5/10 axes

100% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning58.31/60
  • Coding88.52/62
  • Agentic / Tool Use48.52/101
  • Multimodal51.234/125
  • Safety & Alignment72.72/58
23GPT-6 SolOpenAI63.9

11/668 benchmarks · 6/10 axes

86% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning89.92/60
  • Coding83.31/62
  • Agentic / Tool Use60.63/101
  • Multimodal2.83/125
  • Safety & Alignment10.01/58
  • Abstract Reasoning94.01/7
24Gemini 3 ProGoogle63.4

20/668 benchmarks · 8/10 axes

54% high/med confidence

30% self-reported · 70% independent

  • Knowledge & Reasoning83.46/60
  • Math38.12/12
  • Coding68.55/62
  • Agentic / Tool Use56.53/101
  • Multimodal100.01/125
  • Instruction Following11.11/13
  • Safety & Alignment62.51/58
  • Abstract Reasoning90.61/7
25Gemini-3.5-flashGoogle63.1

29/668 benchmarks · 7/10 axes

94% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning92.63/60
  • Coding52.13/62
  • Agentic / Tool Use53.18/101
  • Multimodal77.79/125
  • Safety & Alignment0.01/58
  • Abstract Reasoning81.61/7
  • Multilingual81.14/14
26Grok-4.7xAI63.1

11/668 benchmarks · 6/10 axes

86% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning84.12/60
  • Coding34.62/62
  • Agentic / Tool Use51.84/101
  • Instruction Following84.61/13
  • Safety & Alignment90.01/58
  • Abstract Reasoning75.61/7
27Gemini 3.1 ProGoogle60.5

68/668 benchmarks · 8/10 axes

77% high/med confidence

16% self-reported · 84% independent

  • Knowledge & Reasoning72.811/60
  • Math61.03/12
  • Coding53.610/62
  • Agentic / Tool Use51.117/101
  • Multimodal71.919/125
  • Instruction Following41.93/13
  • Safety & Alignment70.63/58
  • Abstract Reasoning76.12/7
28Qwen Max (2025-01-25)Alibaba59.9

10/668 benchmarks · 6/10 axes

100% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning34.01/60
  • Coding44.42/62
  • Agentic / Tool Use100.01/101
  • Multimodal33.33/125
  • Safety & Alignment70.82/58
  • Multilingual66.71/14
29Qwen3.6 27BAlibaba59.3

15/668 benchmarks · 9/10 axes

94% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning38.82/60
  • Math40.02/12
  • Coding91.72/62
  • Agentic / Tool Use50.02/101
  • Multimodal52.83/125
  • Instruction Following50.01/13
  • Safety & Alignment66.71/58
  • Abstract Reasoning80.01/7
  • Multilingual54.51/14
30Qwen 3.5Alibaba59.2

14/668 benchmarks · 5/10 axes

14% high/med confidence

86% self-reported · 14% independent

  • Knowledge & Reasoning73.14/60
  • Coding68.33/62
  • Agentic / Tool Use47.23/101
  • Multimodal27.83/125
  • Instruction Following77.81/13
31Claude Sonnet 4.5 (2025-09-29)Anthropic59.1

15/668 benchmarks · 7/10 axes

84% high/med confidence

3% self-reported · 97% independent

  • Knowledge & Reasoning51.85/60
  • Coding57.23/62
  • Agentic / Tool Use52.92/101
  • Multimodal85.71/125
  • Instruction Following85.71/13
  • Safety & Alignment54.22/58
  • Abstract Reasoning35.01/7
32Grok-4.6xAI57.8

16/668 benchmarks · 7/10 axes

90% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning80.92/60
  • Math66.71/12
  • Agentic / Tool Use41.65/101
  • Multimodal71.42/125
  • Instruction Following15.41/13
  • Safety & Alignment55.04/58
  • Abstract Reasoning78.61/7
33Gemini 3.5 Flash LiteGoogle57.4

8/668 benchmarks · 6/10 axes

82% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning63.41/60
  • Coding33.31/62
  • Agentic / Tool Use100.01/101
  • Multimodal54.23/125
  • Safety & Alignment0.01/58
  • Abstract Reasoning53.81/7
34Kimi K3Moonshot AI57.3

55/668 benchmarks · 8/10 axes

97% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning51.64/60
  • Math66.71/12
  • Coding46.610/62
  • Agentic / Tool Use64.725/101
  • Multimodal65.67/125
  • Safety & Alignment65.26/58
  • Abstract Reasoning71.41/7
  • Multilingual18.21/14
35Qwen3.8 MaxAlibaba57.3

39/668 benchmarks · 8/10 axes

98% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning52.43/60
  • Math50.01/12
  • Coding51.16/62
  • Agentic / Tool Use59.016/101
  • Multimodal64.77/125
  • Instruction Following69.21/13
  • Safety & Alignment46.94/58
  • Multilingual77.31/14
36DeepSeek ChatDeepSeek56.8

13/668 benchmarks · 7/10 axes

100% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning64.52/60
  • Coding50.03/62
  • Agentic / Tool Use75.01/101
  • Multimodal75.01/125
  • Instruction Following41.71/13
  • Safety & Alignment58.94/58
  • Multilingual0.01/14
37GPT-5OpenAI55.7

18/668 benchmarks · 8/10 axes

85% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning66.54/60
  • Coding58.93/62
  • Agentic / Tool Use30.22/101
  • Multimodal86.34/125
  • Instruction Following100.01/13
  • Safety & Alignment34.12/58
  • Abstract Reasoning53.01/7
  • Multilingual14.31/14
38Qwen3.7 MaxAlibaba55.3

13/668 benchmarks · 6/10 axes

93% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning70.73/60
  • Coding36.32/62
  • Agentic / Tool Use46.73/101
  • Instruction Following100.01/13
  • Safety & Alignment55.63/58
  • Multilingual40.01/14
39Qwen3.7 PlusAlibaba54.7

11/668 benchmarks · 5/10 axes

92% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning75.41/60
  • Agentic / Tool Use58.93/101
  • Multimodal51.05/125
  • Safety & Alignment30.81/58
  • Multilingual30.01/14
40Kimi K2.5Moonshot AI54.4

31/668 benchmarks · 8/10 axes

64% high/med confidence

23% self-reported · 77% independent

  • Knowledge & Reasoning57.57/60
  • Math86.42/12
  • Coding55.56/62
  • Agentic / Tool Use40.26/101
  • Multimodal34.75/125
  • Instruction Following94.41/13
  • Safety & Alignment18.82/58
  • Abstract Reasoning37.42/7
41GPT-5.1OpenAI54.4

12/668 benchmarks · 6/10 axes

76% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning64.73/60
  • Coding38.82/62
  • Agentic / Tool Use52.02/101
  • Safety & Alignment79.23/58
  • Abstract Reasoning58.11/7
  • Multilingual57.11/14
42google/gemma-4-31B-itGoogle54.3

24/668 benchmarks · 7/10 axes

96% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning37.44/60
  • Coding71.42/62
  • Agentic / Tool Use30.17/101
  • Multimodal50.88/125
  • Instruction Following100.01/13
  • Safety & Alignment22.21/58
  • Abstract Reasoning70.01/7
43GPT-5.2-chatOpenAI54.2

21/668 benchmarks · 7/10 axes

88% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning59.46/60
  • Coding39.84/62
  • Agentic / Tool Use61.52/101
  • Multimodal63.46/125
  • Safety & Alignment85.71/58
  • Abstract Reasoning67.51/7
  • Multilingual0.01/14
44Qwen3.8 27BAlibaba54.0

30/668 benchmarks · 8/10 axes

94% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning50.01/60
  • Math100.01/12
  • Coding58.33/62
  • Agentic / Tool Use38.811/101
  • Multimodal57.49/125
  • Long Context12.51/2
  • Safety & Alignment42.73/58
  • Abstract Reasoning65.81/7
45qwen3.5-27BAlibaba52.2

22/668 benchmarks · 7/10 axes

100% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning21.42/60
  • Math60.02/12
  • Coding66.72/62
  • Agentic / Tool Use35.63/101
  • Multimodal66.010/125
  • Safety & Alignment72.22/58
  • Abstract Reasoning60.01/7
46GPT-5.4-miniOpenAI52.1

20/668 benchmarks · 8/10 axes

92% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning47.25/60
  • Math60.01/12
  • Coding65.63/62
  • Agentic / Tool Use32.95/101
  • Multimodal25.02/125
  • Long Context75.01/2
  • Safety & Alignment72.71/58
  • Abstract Reasoning49.92/7
47DeepSeek V4.1 FlashDeepSeek51.8

40/668 benchmarks · 8/10 axes

96% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning63.54/60
  • Math58.32/12
  • Coding58.55/62
  • Agentic / Tool Use43.821/101
  • Multimodal22.12/125
  • Instruction Following23.11/13
  • Safety & Alignment47.23/58
  • Abstract Reasoning91.52/7
48Claude 3.5 SonnetAnthropic51.8

12/668 benchmarks · 6/10 axes

96% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning41.94/60
  • Math30.01/12
  • Coding48.24/62
  • Agentic / Tool Use61.51/101
  • Instruction Following50.01/13
  • Safety & Alignment100.01/58
49DeepSeek V3.2DeepSeek51.8

24/668 benchmarks · 5/10 axes

66% high/med confidence

24% self-reported · 76% independent

  • Knowledge & Reasoning47.76/60
  • Math45.51/12
  • Coding26.38/62
  • Agentic / Tool Use68.07/101
  • Safety & Alignment100.02/58
50o3OpenAI51.4

13/668 benchmarks · 7/10 axes

76% high/med confidence

0% self-reported · 100% independent

  • Knowledge & Reasoning60.34/60
  • Math100.01/12
  • Coding51.93/62
  • Agentic / Tool Use8.31/101
  • Multimodal58.92/125
  • Safety & Alignment57.11/58
  • Abstract Reasoning48.71/7
Top 50 of 111 models that meet the minimum coverage (37 sparse and 1,359 N/A hidden).
How the composite is computed

0. Only benchmarks that are still being measured count: a benchmark needs a dated score within 730 days of the newest score in the dataset, and at least 3 models scored on it. Stale benchmarks measured only on older models would otherwise inflate those models.

1. On each benchmark, a model's best score is turned into a percentile rank among all models scored there (100 = best, 0 = worst; lower-is-better metrics are inverted). Ranks, not raw numbers, so an easy benchmark does not outweigh a hard one.

2. For each model, the best score per benchmark is used. In Any harness mode this is across all harnesses; in Grouped mode each (model, harness) pair is scored separately.

3. Each capability axis is the weighted mean of its benchmarks (a benchmark counts under its primary axis). Saturated benchmarks are down-weighted to 0.5x because they discriminate less.

4. The composite is the weighted mean over covered axes with weights Knowledge & Reasoning 1, Math 1, Coding 1.5, Agentic / Tool Use 1.5, Multimodal 0.75, Long Context 0.75, Instruction Following 0.75, Safety & Alignment 0.5, Abstract Reasoning 0.75, Multilingual 0.5. A model needs at least 5 benchmarks across 3 axes, otherwise the composite is N/A.

Source types counted: Self-reported, Independent, Reproduced. The same algorithm ships in the shared package (@ltb/shared, computeCompositeScores) and in the CLI, so numbers match everywhere.

Model × benchmark

Columns are benchmarks grouped by primary axis; cells show the normalized score (0–100) of the best included source. Hover or focus a cell for the raw value and source link.

Sources
Top 40 of 870 models (ordered by composite rank, then coverage) × 75 benchmarks (top 8 per axis by score count), metadata ≥60% complete
ModelKnowledge & ReasoningMathCodingAgentic / Tool UseMultimodalLong ContextInstruction FollowingSafety & AlignmentAbstract ReasoningMultilingual
GPQA DiamondMMLUBoolQCritPtHellaSwagWinoGrandePIQASimpleQA VerifiedGSM8KMATHAIME 2025EfficientOptGraphDecideNLData2OptMATH-500TheoremQASciCodeAider PolyglotSWE-bench VerifiedMBPPWeb-BenchGSODeepSWEANCHORTerminal-BenchDeepResearch BenchKlinikeBenchOSWorldEnterpriseBenchArgo-BenchTheAgentCompanyVAmoS EnergyVideo-MMEMM-VetGDP.pdfGeoBenchSQUARE-BenchOmniVCBenchCogEmo-BenchR-GroundBenchMMNeedleLongHarness BenchMINTEvalQuALITYscrollsNonlinear Narrative G…WISEIFEvalIntent-EvalSimIF-BenchSIT-EvalTypedBenchCreativePreferencesCybenchSynthPAIDistressBenchBrowseSafe++OMITDRYLAB-BenchINFUSEJUPEARC-AGI-2ArgGYMDrillBenchGrid-Benchauto-nesy-benchFoldBenchSiLTTsk-benchSUITE-102EHR-BenchTRuSTCSWBenchLingOlyBilliger.de Products
GPT-6 Astra96I32I76I56I79I74I24I52I34I92I17I95I53I
GPT-5.4 Pro95I30I46I75S83I
Claude Sonnet 5.596I31I47I61I52I31I
Claude Fable 586I29I71I61I78I70I30I0I89I
Gemini 3 Flash Preview89I67I75I10I58I64I50I10I88I100I34I
GPT-5.493I23I45I57I77I31I52I12I82I35I23I75S87I85I74I44I
Claude Opus 4.790I12I52I55I83I44I80I21I76I
Claude Opus 4.691S47I100S83I1I98S81S41I80I55I73S94S93S69S
GPT-5.6 Sol93I32I70I57I76I73I24I31I55I60I76I1I59I93I82I0I100I
GPT-6.1 Sol95I32I74I56I50I35I94I
Gemini 3.6 Flash94I11I66I53I47I14I100I86I60I
GPT-5.591I27I63I87I56I40I67I85I54I17I26I74I63I89I85I100I89I
Claude Fable 5.131I71I63I88I30I1I90I90I
Claude Opus 594I29I60I56I74I29I24I65I10I90I40I
Claude Opus 4.5 (2025-11-01)81I77I27I63I55I66S75I87I82S8I
Gemini 3.7 Flash95I14I69I60I65I11I24I85I
Gemini 3.8 Flash95I18I70I57I74I19I26I23I10I73I89I
Claude Opus 5.591I32I72I67I29I60I31I1I87I93I
Grok 4.593I15I48I54I54I14I81I100I53I
Gemini 2.0 Flash Experimental80I90I22I15I81I100I
Claude Sonnet 4.690S3I36I53S1I98S47I80S30I53I55I73S18I71I60I60I
Qwen2.5-VL-7B27I
Claude Opus 4.894S21I53I53I89S47I59I19I50I17I24I80I1I13I72I97I
GPT-5.6-terra93I30I43I55I70I8I25I72I1I30I84I89I
Gemini 1.5 Pro81I81I92I68I23I
Qwen3-VL-8B-Instruct87I34I65I80I
GPT-6 Sol94I31I61I58I37I26I90I
Gemini 3 Pro93I7I96S91S75S19I69I46I84I91I82S85S
Gemini-3.5-flash93I13I66I53I79I37I16I14I72I69I98I67I
Grok-4.793I18I56I57I22I23I61I
DeepSeek V4 Pro 081392I18I53I51I61I
Grok 4 070987I80I27I47I45I43S16I
Gemini 3.1 Pro94I18I74I100S57I94S59I78S23I12I80I48I17I91I85S89I96I77I
Jev 1.131I89I
Qwen Max (2025-01-25)56I22I16I
Qwen3.6 27B86I1I0I37I92I48I
Qwen 3.588S76S62S93S
Claude Sonnet 4.5 (2025-09-29)74I1I24I45I71I15I47I48I63I49I1I60S100I4I
Grok-4.694I20I49I56I67I22I17I50I67I
Qwen3.5 Plus85I25I
0
100 normalized
S Self-reportedI IndependentR Reproduced
low confidence (hatched)· = no sourced score