LetTokenBurnBenchHub

Model

qwen3.5-9B

Alibaba · open weights

qwenlm.github.io

Knowledge & Reasoning

Knowledge & Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
CritPt	0.3	accuracy	N/A	Independent	low	epoch.ai
GPQA Diamond	79.0	accuracy	N/A	Independent	high	epoch.ai
LLM4Impact Dataset	2.0	rmse	zero-shot	Independent	medium	arxiv.org
Unanswerability Benchmark	0.8	auroc	N/A	Independent	medium	arxiv.org

Math

Benchmark	Score	Metric	Harness	Source	Confidence	Link
GraphDecide	99.8	accuracy	N/A	Independent	medium	arxiv.org

Coding

Benchmark	Score	Metric	Harness	Source	Confidence	Link
ChartRevise	94.3	exact-edit_rate	N/A	Independent	medium	arxiv.org
Closed-loop evaluation benchmark for embedded coding agents	13.3	pass_rate	N/A	Independent	medium	arxiv.org
Mobility Data Engineering Benchmark	69.3	success_rate	N/A	Independent	medium	arxiv.org
SciCode	27.5	score	N/A	Independent	medium	artificialanalysis.ai

Agentic / Tool Use

Agentic / Tool Use

Benchmark	Score	Metric	Harness	Source	Confidence	Link
EC2-Bench	39.1	completion	N/A	Independent	medium	arxiv.org
Healthcare Escalation Benchmark	0.8	dec._acc.	N/A	Independent	medium	arxiv.org
PlanBench	49.2	accuracy	N/A	Independent	medium	arxiv.org
Terminal-Bench	9.2	accuracy	little-coder	Independent	medium	tbench.ai
TiGanEval	0.0	success_rate	N/A	Independent	medium	arxiv.org

Multimodal

Benchmark	Score	Metric	Harness	Source	Confidence	Link
@BENCH	65.0	accuracy	N/A	Independent	medium	arxiv.org
CREATE	35.1	accuracy	N/A	Independent	medium	arxiv.org
DSV-Mem	7.2	accuracy	N/A	Independent	medium	arxiv.org
EgoGears	21.1	accuracy	N/A	Independent	medium	arxiv.org
Event-STVG	0.1	m-viou	N/A	Independent	medium	arxiv.org
Game2Real-Bench	35.7	accuracy	N/A	Independent	medium	arxiv.org
GeoSpatialBench	46.5	accuracy	N/A	Independent	medium	arxiv.org
MVGraph	13.5	accuracy	N/A	Independent	medium	arxiv.org
P^3IBench	26.1	overall_average_prs-b	N/A	Independent	medium	arxiv.org
SpaceCast-Bench	34.6	accuracy	N/A	Independent	medium	arxiv.org
SpaceConflict	59.3	accuracy	N/A	Independent	medium	arxiv.org
TRAJECTORY-144	61.6	accuracy	tracer	Independent	medium	arxiv.org
VisualTrust	89.1	accuracy	N/A	Independent	medium	arxiv.org
VisualWorldBench	46.6	accuracy	N/A	Independent	medium	arxiv.org

Safety & Alignment

Safety & Alignment

Benchmark	Score	Metric	Harness	Source	Confidence	Link
LinguaGuardBench	1.6	flip_rate	N/A	Independent	medium	arxiv.org
OMIT	0.3	obr	N/A	Independent	medium	arxiv.org
Unified Misuse Monitoring Benchmark	0.9	auc	N/A	Independent	medium	arxiv.org

Abstract Reasoning

Abstract Reasoning

Benchmark	Score	Metric	Harness	Source	Confidence	Link
FoldBench	0.2	tm-score	N/A	Independent	medium	arxiv.org
SyntaxBench	74.5	accuracy	N/A	Independent	medium	arxiv.org

Reproduced by the community