IBM: Granite 4.2 8B

IBM Granite 4.2 8B demonstrates moderate speed performance, ranking in the 24th percentile across benchmarks. It generally offers cost-effective solutions, placing in the 69th percentile for price. Notably, the model exhibits exceptional reliability with a 99% success rate, indicating minimal technical failures. In terms of specific performance, Granite 4.2 8B achieves perfect accuracy in Hallucinations, effectively acknowledging uncertainty, and is the most accurate model at its price point and speed for this task. It also performs strongly in Email Classification (99.0% accuracy) and Coding (91.0% accuracy). However, its Instruction Following (68.7% accuracy) and General Knowledge (75.0% accuracy) are average, while Reasoning (26.0% accuracy) and Mathematics (80.0% accuracy) show significant room for improvement, particularly given its description as a "dense reasoning model." Despite its strengths in specific areas, its overall speed is a limiting factor in several benchmarks, with very low percentile rankings in Instruction Following, Coding, and Mathematics duration.