Model

Grok-4.7

xAI · closed weights

x.ai

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
CritPt17.7accuracyN/AIndependentlowepoch.ai
GPQA Diamond92.7accuracyN/AIndependenthighepoch.ai
SimpleQA Verified56.0accuracyN/AIndependenthighepoch.ai

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
Doc2Harness43.5pass_rateN/AIndependentmediumarxiv.org
SciCode57.4scoreN/AIndependentmediumartificialanalysis.ai
Zero2Repo63.6success_ratecursor cliIndependentmediumarxiv.org

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
DAYJOB8.4success_rateN/AIndependentmediumarxiv.org
Incident-Arena0.3pass@1grok buildIndependentmediumarxiv.org
KlinikeBench22.2strict_pass@1N/AIndependentmediumarxiv.org
OfficeTown Bench58.4pass@1N/AIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
GDP.pdf22.8gdp.pdf_scoreN/AIndependentmediumsurgehq.ai

Instruction Following

Instruction Following
BenchmarkScoreMetricHarnessSourceConfidenceLink
Design Creativity Bench62.2overallN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
CWE-bench68.0pass@1opencodeIndependentmediumarxiv.org

Abstract Reasoning

Abstract Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ARC-AGI-261.4scoreN/AIndependentlowepoch.ai

Reproduced by the community

Loading community runs…