IBM: Granite 4.2 8B

IBM Granite 4.2 8B demonstrates moderate speed performance, ranking in the 26th percentile across benchmarks, and offers cost-effective solutions, placing in the 68th percentile for pricing. Notably, it exhibits exceptional reliability with a 99% success rate, consistently providing usable responses. The model excels in specific areas, achieving perfect accuracy in Hallucinations (Baseline), indicating a strong ability to acknowledge uncertainty. It also performs very well in Email Classification (99.0% accuracy) and Coding (91.0% accuracy), suggesting proficiency in structured data processing and programming tasks. Its Ethics performance is also strong at 98.0% accuracy. However, Granite 4.2 8B shows significant weaknesses in Reasoning (26.0% accuracy) and General Knowledge (75.0% accuracy), indicating challenges with complex problem-solving and broad factual recall. Its Instruction Following capability is moderate at 68.7% accuracy. While generally cost-effective, its duration for Instruction Following and Coding benchmarks is notably slow. Overall, the model is a reliable and cost-efficient option for tasks requiring precise classification, coding, and hallucination avoidance, but may struggle with highly complex reasoning or extensive general knowledge queries.