Model
Qwen3 1.7B
Alibaba · open weights
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| GPQA Diamond | 38.0 | accuracy | N/A | Independent | high | epoch.ai |
| OTel | 52.8 | score | N/A | Independent | medium | arxiv.org |
| Perceive, Solve, Reason Suite | 79.0 | accuracy | N/A | Independent | medium | arxiv.org |
| PhysicsMate | 5.5 | accuracy | lora adaptation | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Healthcare Escalation Benchmark | 0.4 | dec._acc. | N/A | Independent | medium | arxiv.org |
Safety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| Guise | 78.4 | attack_success_rate | N/A | Independent | medium | arxiv.org |
| PFaithBench | 48.2 | overans | N/A | Independent | medium | arxiv.org |
Multilingual
MultilingualReproduced by the community
Loading community runs…