IBM: Granite 4.1 8B

IBM Granite 4.1 8B demonstrates competitive response times, ranking in the 57th percentile for speed across various benchmarks. It consistently offers among the most competitive pricing, placing in the 88th percentile. The model exhibits exceptional reliability with a 99% success rate, indicating minimal technical failures. In terms of performance across categories, Granite 4.1 8B shows strong capabilities in Hallucinations (98.0% accuracy, 73rd percentile) and Ethics (99.0% accuracy, 59th percentile). Its Email Classification performance is a standout, achieving 95.0% accuracy and ranking #1 in speed, demonstrating near-perfect accuracy at the highest speed. However, the model shows notable weaknesses in Instruction Following (15.0% accuracy, 20th percentile), Reasoning (42.0% accuracy, 22nd percentile), and Mathematics (68.0% accuracy, 25th percentile), where its accuracy falls into lower percentiles. General Knowledge and Coding performance are moderate, at 91.5% and 78.0% accuracy respectively, but with lower percentile rankings.