Google: Gemma 3 27B

Google's Gemma 3 27B, released on March 11, 2025, is a multimodal AI model supporting vision-language input and text outputs, with a substantial context length of 131072 tokens and multilingual capabilities across over 140 languages. It demonstrates competitive response times, ranking in the 53rd percentile across benchmarks, and offers cost-effective solutions, placing in the 80th percentile for pricing. A standout feature is its exceptional reliability, achieving a 100% success rate across all evaluated benchmarks, indicating consistent and stable performance. In terms of specific performance, Gemma 3 27B shows strong capabilities in Ethics, achieving perfect 100% accuracy, making it the most accurate model at its price point and among models of similar speed. It also performs well in General Knowledge (98.0% accuracy) and Coding (89.0% accuracy), ranking in the 52nd and 64th percentiles respectively. While its Mathematics performance is moderate at 84.0% accuracy, its primary weakness lies in Instruction Following, where it scored a low 8.0% accuracy, placing it in the 19th percentile. Reasoning and Email Classification show average performance. Overall, Gemma 3 27B is a reliable and cost-efficient model with notable strengths in ethical reasoning, general knowledge, and coding, though its instruction-following capabilities require further development.