Mistral: Mistral Small 3.1 24B

Mistral Small 3.1 24B, created by mistralai, demonstrates a strong overall performance profile. It consistently performs in the top tier for speed, ranking in the 68th percentile across benchmarks, indicating efficient processing. Furthermore, its pricing is highly competitive, placing it in the 87th percentile, making it a cost-effective solution. The model exhibits exceptional reliability with a perfect 100% success rate across all evaluated benchmarks, ensuring consistent and usable responses. In terms of specific benchmark performance, Mistral Small 3.1 24B shows particular strength in Ethics and General Knowledge, achieving 99.0% and 98.7% accuracy respectively, placing it in the 65th and 67th percentiles for these categories. Its Reasoning capabilities are also solid at 62.0% accuracy (78th percentile for duration), and it handles Coding tasks with 81.0% accuracy. While its Instruction Following (54.3%) and Email Classification (96.0%) accuracies are moderate, its cost-efficiency in these areas is notable. The model's 128k token context window and optimization for local inference further enhance its utility for diverse applications.