LetTokenBurnBenchHub

Model

Qwen3.8 27B

Alibaba · open weights

qwenlm.github.io

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
CritPt	5.4	accuracy	N/A	Independent	low	epoch.ai
DCBench-440	63.0	accuracy	openrouter	Independent	medium	arxiv.org
DCBench-440	53.0	accuracy	groq	Independent	medium	arxiv.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GraphDecide	100.0	accuracy	N/A	Independent	medium	arxiv.org

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
CRUXEval-style	39.4	accuracy	N/A	Independent	medium	arxiv.org
HPCAgent-Bench	54.5	speedup	cc	Independent	medium	arxiv.org
RAP	0.6	lpips	N/A	Independent	medium	arxiv.org
SciCode	46.6	score	N/A	Independent	medium	artificialanalysis.ai

Agentic / Tool Use

Agentic / Tool Use

Benchmark	Score	Metric	Harness	Source	Confidence	Link
Autonomous Science Bench	5.6	success_rate	N/A	Independent	medium	arxiv.org
BioStudyBench	56.0	pass_rate	N/A	Independent	medium	arxiv.org
DUDA-Bench	0.1	workflow_score	react	Independent	medium	arxiv.org
DyadMem	54.5	accuracy	N/A	Independent	medium	arxiv.org
GraceBench	0.6	recovery_ability	N/A	Independent	medium	arxiv.org
HICO-Bench	54.6	success_rate	N/A	Independent	medium	arxiv.org
KiranaBench	13683.0	profit	N/A	Independent	medium	arxiv.org
PersonaCUABench	15.0	success_rate	N/A	Independent	medium	arxiv.org
PlanBench	62.2	accuracy	N/A	Independent	medium	arxiv.org
TiGanEval	0.0	success_rate	N/A	Independent	medium	arxiv.org
TrialPD-Bench	68.3	f1	N/A	Independent	medium	arxiv.org

Multimodal

Benchmark	Score	Metric	Harness	Source	Confidence	Link
APM-Bench	42.4	overall_score	N/A	Independent	medium	arxiv.org
CREATE	39.6	accuracy	N/A	Independent	medium	arxiv.org
Ego-SpaCR	22.3	accuracy	native video	Independent	medium	arxiv.org
EMBER-Bench	43.0	accuracy	N/A	Independent	medium	arxiv.org
Game2Real-Bench	52.6	accuracy	N/A	Independent	medium	arxiv.org
GeoSpatialBench	52.5	accuracy	N/A	Independent	medium	arxiv.org
InstanceBench	63.5	[email protected]	N/A	Independent	medium	arxiv.org
ProPerMem	7.0	accuracy	rag	Independent	medium	arxiv.org
SpaceConflict	56.6	accuracy	N/A	Independent	medium	arxiv.org

Long Context

Benchmark	Score	Metric	Harness	Source	Confidence	Link
LongHarness Bench	0.0	accuracy	direct	Independent	medium	arxiv.org

Safety & Alignment

Safety & Alignment

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ImpactBench	67.8	impactbench_pos._(%)	N/A	Independent	medium	arxiv.org
LinguaGuardBench	0.7	flip_rate	N/A	Independent	medium	arxiv.org
ObligationBench	20.9	recall	N/A	Independent	medium	arxiv.org

Abstract Reasoning

Abstract Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ARC-AGI-2	42.4	score	N/A	Independent	low	epoch.ai

Reproduced by the community