Google: Gemma 4 26B A4B

Google's Gemma 4 26B A4B IT demonstrates strong overall performance, particularly excelling in reliability with a perfect 100% success rate across all benchmarks, indicating consistent and usable responses. The model performs among the fastest models, typically ranking in the top tier for speed (73rd percentile), and offers competitive pricing, generally providing cost-effective solutions (76th percentile). In terms of specific benchmarks, Gemma 4 26B A4B IT shows excellent performance in mitigating hallucinations, achieving 98.0% accuracy by appropriately acknowledging uncertainty. Its instruction following capabilities are solid, with 71.0% accuracy, placing it in the 77th percentile for this category. Email classification also yielded strong results at 98.0% accuracy. While its duration for email classification was in the 51st percentile, its speed for hallucination and instruction following tests was notably high (82nd and 85th percentile, respectively). Key strengths include its exceptional reliability, strong hallucination mitigation, and efficient inference due to its MoE architecture, delivering near-31B quality at a fraction of the compute cost. No significant weaknesses were identified in the provided benchmarks.