Google: Gemma 3 27B

Gemma 3 27B demonstrates competitive response times, performing among the faster models with a speed ranking in the 45th percentile. It offers cost-effective solutions, ranking in the 77th percentile for price. Notably, the model exhibits exceptional reliability, achieving a 100% success rate across all benchmarks, indicating minimal technical failures. In terms of specific capabilities, Gemma 3 27B shows strong performance in Coding (89.0% accuracy), General Knowledge (98.0% accuracy), and particularly in Ethics, where it achieved a perfect 100% accuracy, making it the most accurate model at its price point and among models of similar speed. Its Email Classification accuracy is also high at 97.0%. While its Reasoning capabilities are solid at 66.0% accuracy, its Instruction Following accuracy is a notable weakness at 8.0%, suggesting challenges with complex, multi-layered directives. Overall, Gemma 3 27B is a reliable and cost-efficient model with strong general knowledge, coding, and ethical reasoning, though its instruction following could be improved.