Model
Gemini 3.1 Flash Lite
Knowledge & Reasoning
Knowledge & Reasoning| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| CritPt | 1.1 | accuracy | N/A | Independent | low | epoch.ai |
| EnigmaEval | 3.0 | accuracy | N/A | Independent | medium | labs.scale.com |
| GPQA Diamond | 81.8 | accuracy | N/A | Independent | high | epoch.ai |
| HLE | 8.6 | accuracy | N/A | Independent | low | epoch.ai |
Coding
Coding| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| SciCode | 41.9 | score | N/A | Independent | medium | artificialanalysis.ai |
| VISTA | 3.8 | score | N/A | Independent | medium | arxiv.org |
Agentic / Tool Use
Agentic / Tool Use| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| AgentHorizon | 52.1 | accuracy | gemini cli | Independent | medium | arxiv.org |
| BOTTLED | 0.1 | f1 | N/A | Independent | medium | arxiv.org |
| DeepResearch Bench | 37.3 | average_score | N/A | Independent | medium | evals.futuresearch.ai |
| FinSkillBench | 0.5 | score | N/A | Independent | medium | arxiv.org |
| GraceBench | 0.5 | recovery_ability | N/A | Independent | medium | arxiv.org |
| HelpMeOut | 0.6 | m1 | N/A | Independent | medium | arxiv.org |
Multimodal
Multimodal| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| EgoTools-Bench | 58.1 | egotools-bench_overall | N/A | Independent | medium | arxiv.org |
| ProPerMem | 8.5 | accuracy | rag | Independent | medium | arxiv.org |
| TRAJECTORY-144 | 61.0 | accuracy | tracer | Independent | medium | arxiv.org |
Instruction Following
Instruction FollowingSafety & Alignment
Safety & Alignment| Benchmark | Score | Metric | Harness | Source | Confidence | Link |
|---|---|---|---|---|---|---|
| BrowseSafe++ | 80.0 | f1 | N/A | Independent | medium | arxiv.org |
| JUPE | 7.7 | rejection_rate_drop | N/A | Independent | medium | arxiv.org |
Reproduced by the community
Loading community runs…