Model

google/gemma-4-26B-A4B-it

Google

deepmind.google

Knowledge & Reasoning

Knowledge & Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
CritPt0.0accuracyN/AIndependentlowepoch.ai
GPQA Diamond73.2accuracyN/AIndependenthighepoch.ai
HeRE0.9f1N/AIndependentmediumarxiv.org

Coding

Coding
BenchmarkScoreMetricHarnessSourceConfidenceLink
SciCode40.0scoreN/AIndependentmediumartificialanalysis.ai

Agentic / Tool Use

Agentic / Tool Use
BenchmarkScoreMetricHarnessSourceConfidenceLink
AgentHorizon49.4accuracyopencodeIndependentmediumarxiv.org
PlaySuite0.7mean_progress_score_(no_history)N/AIndependentmediumarxiv.org
ReFract0.2success_ratefunction callingIndependentmediumarxiv.org

Multimodal

Multimodal
BenchmarkScoreMetricHarnessSourceConfidenceLink
VisualTrust78.6accuracyN/AIndependentmediumarxiv.org
VisualWorldBench36.5accuracyN/AIndependentmediumarxiv.org

Instruction Following

Instruction Following
BenchmarkScoreMetricHarnessSourceConfidenceLink
Intent-Eval91.7accuracyN/AIndependentmediumarxiv.org

Safety & Alignment

Safety & Alignment
BenchmarkScoreMetricHarnessSourceConfidenceLink
LinguaGuardBench0.5flip_rateN/AIndependentmediumarxiv.org
Unified Misuse Monitoring Benchmark0.9aucN/AIndependentmediumarxiv.org

Abstract Reasoning

Abstract Reasoning
BenchmarkScoreMetricHarnessSourceConfidenceLink
ArgGYM75.1accuracyN/AIndependentmediumarxiv.org

Multilingual

Multilingual
BenchmarkScoreMetricHarnessSourceConfidenceLink
TRuST34.3recallt-searchIndependentmediumarxiv.org

Reproduced by the community

Loading community runs…