Mistral Large 2407

Mistral Large 2407, Mistral AI's flagship model, demonstrates strong overall performance, particularly excelling in reliability and speed. It performs among the fastest models, ranking in the 75th percentile for speed across six benchmarks. While its pricing is moderate, falling into the 28th percentile, its exceptional reliability is a standout feature, achieving a perfect 100th percentile with minimal technical failures. Across benchmark categories, Mistral Large 2407 shows notable strengths in classification and general knowledge, achieving 99.0% and 99.5% accuracy respectively. Its instruction following capabilities are also strong at 62.0% accuracy. In coding, it performs well with 82.0% accuracy, indicating proficiency across various programming languages. However, its performance in complex reasoning tasks is a relative weakness, with 52.0% accuracy. Despite this, its ethical reasoning is robust at 99.0% accuracy. The model's long context window and multilingual support further enhance its versatility, making it a powerful tool for diverse applications requiring precise information recall and broad language capabilities.