LetTokenBurnBenchHub

Model

DeepSeek V4 Pro

DeepSeek · open weights

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
AI Consilium	2.5	mean_judge_score	structured	Independent	medium	arxiv.org
CL-bench Life	13.5	overall	N/A	Independent	low	epoch.ai
CritPt	12.9	accuracy	N/A	Independent	low	epoch.ai
GPQA Diamond	90.9	accuracy	N/A	Independent	high	epoch.ai
HouseholdBench	1.0	relmae	N/A	Independent	medium	arxiv.org
LexPilot	0.6	lca_macro-f1	N/A	Independent	medium	arxiv.org
MOF-VERIFY	62.8	macro-f1	N/A	Independent	medium	arxiv.org
PerSo	62.0	accuracy	N/A	Independent	medium	arxiv.org
SimpleQA Verified	47.0	accuracy	N/A	Independent	high	epoch.ai

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
Australian SOC Benchmark	76.1	t2_accuracy	N/A	Independent	medium	arxiv.org

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
A2Z GameSpec-Bench	50.4	gdd_fidelity	N/A	Independent	medium	arxiv.org
AAArena	2288.2	elo	codex	Independent	medium	arxiv.org
ArchitectureIQ	68.4	accuracy	architectureiq	Independent	medium	arxiv.org
ArrivalBench	45.3	failure_rate	N/A	Independent	medium	arxiv.org
MetaKernelBench	25.7	paired_lift	cute dsl	Independent	medium	arxiv.org
ModeBench	0.3	pcmd	N/A	Independent	medium	arxiv.org
SCCGBench	3.8	mock	N/A	Independent	medium	arxiv.org
SciCode	50.0	score	N/A	Independent	medium	artificialanalysis.ai
SimuVerity	28.4	score	claude code	Independent	medium	arxiv.org
SpecGuardBench	66.7	accuracy	opencode	Independent	medium	arxiv.org
SWE-bench Verified	77.6	resolved_rate	N/A	Independent	high	epoch.ai
SWE-Duel	1.5	bradley_terry_log_strength	mini-swe-agent	Independent	medium	arxiv.org

Agentic / Tool Use

Agentic / Tool Use

Benchmark	Score	Metric	Harness	Source	Confidence	Link
AgentDecisionBench	7.2	success_rate	N/A	Independent	medium	arxiv.org
AgenticBBO-Bench	0.5	hpo	N/A	Independent	medium	arxiv.org
AgentMonBench	0.5	silentswap	N/A	Independent	medium	arxiv.org
APTInvestBench	50.8	coverage_rate	N/A	Independent	medium	arxiv.org
CSEG-Bench	0.8	exact	N/A	Independent	medium	arxiv.org
DataSense-Bench	36.5	accuracy	N/A	Independent	medium	arxiv.org
DyadMem	66.1	accuracy	N/A	Independent	medium	arxiv.org
EC2-Bench	72.9	completion	N/A	Independent	medium	arxiv.org
HelpMeOut	0.7	m1	N/A	Independent	medium	arxiv.org
HICO-Bench	59.2	success_rate	N/A	Independent	medium	arxiv.org
IGMBench	31.8	success_rate	N/A	Independent	medium	arxiv.org
Legal Research Bench	23.2	accuracy	N/A	Independent	medium	arxiv.org
LifeSearch	46.9	score	N/A	Independent	medium	arxiv.org
OfficeTown Bench	18.5	pass@1	N/A	Independent	medium	arxiv.org
PraxisMemBench	49.8	success_rate	N/A	Independent	medium	arxiv.org
StoreBench	0.7	composite	N/A	Independent	medium	arxiv.org
Synthetic Trading Benchmark	8.2	e0_sharpe	N/A	Independent	medium	arxiv.org
XiangqiBench	5.0	pass@3	N/A	Independent	medium	arxiv.org

Multimodal

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ChemArgus	25.0	full_problem	text only	Independent	medium	arxiv.org
R-GroundBench	71.0	accuracy	N/A	Independent	medium	arxiv.org

Instruction Following

Instruction Following

Benchmark	Score	Metric	Harness	Source	Confidence	Link
Nonlinear Narrative Generation Benchmark	0.5	acc.	N/A	Independent	medium	arxiv.org
UXBench Pro	0.0	turn_bt	N/A	Independent	medium	arxiv.org
WISE	55.0	compliance	N/A	Independent	medium	arxiv.org

Safety & Alignment

Safety & Alignment

Benchmark	Score	Metric	Harness	Source	Confidence	Link
AgentPrivArena	19.3	leak_rate_(%,_↓)	agentprivarena	Independent	medium	arxiv.org
DecepEval	80.6	deception_rate	N/A	Independent	medium	arxiv.org
ObligationBench	33.6	recall	N/A	Independent	medium	arxiv.org
OverAct	2.4	sir	N/A	Independent	medium	arxiv.org
ProtoArena	35.0	success_rate	openhands	Independent	medium	arxiv.org
SWE-DeceptionBench	74.2	active_deception_rate	N/A	Independent	medium	arxiv.org
Trapped in Your Story	99.8	reversal_any_(%)	N/A	Independent	medium	arxiv.org

Multilingual

Benchmark	Score	Metric	Harness	Source	Confidence	Link
CSWBench	16.6	cswbench_extended_/20	N/A	Independent	medium	arxiv.org
EHR-Bench	86.0	constructed_ba	N/A	Independent	medium	arxiv.org
HakemBench	0.6	composite	N/A	Independent	medium	arxiv.org

Reproduced by the community