Mistral: Ministral 3 8B 2512

Mistral: Ministral 3 8B 2512, a balanced model from mistralai, demonstrates exceptional performance across several key metrics. It consistently ranks among the fastest models, achieving an Infinityth percentile in speed across eight benchmarks. Similarly, its pricing is highly competitive, also securing an Infinityth percentile ranking across eight benchmarks. The model exhibits outstanding reliability with a 99% success rate, indicating minimal technical failures and consistent evaluable responses. In terms of specific benchmarks, Ministral 3 8B shows strong performance in General Knowledge (96.0% accuracy), Ethics (97.0% accuracy), and Coding (87.0% accuracy), placing it in the 40th, 31st, and 57th percentiles respectively. A notable weakness is its 0.0% accuracy in the Hallucinations benchmark, suggesting it does not appropriately acknowledge uncertainty when presented with fictional concepts. Its Instruction Following (44.0% accuracy) and Reasoning (52.0% accuracy) capabilities are also areas for potential improvement, ranking in the 35th and 30th percentiles. Despite these, its efficiency is evident in its low cost and relatively fast durations across most tests.