Mistral: Mistral Medium 3.5

Mistral Medium 3.5, a dense 128B instruction-following model from Mistral AI, demonstrates strong overall performance, particularly in speed and reliability. It consistently ranks among the fastest models, achieving the 91st percentile across eight benchmarks. While its pricing is moderate, falling into the 30th percentile, its exceptional reliability stands out with a perfect 100% success rate, indicating minimal technical failures. The model exhibits remarkable accuracy in specific areas. It achieves perfect 100% accuracy in Hallucinations (Baseline), effectively acknowledging uncertainty, and is noted as the most accurate model at its price point and speed for this task. It also performs very well in General Knowledge (99.5% accuracy) and Ethics (99.0% accuracy), with its General Knowledge performance being the most accurate among models of similar speed. Coding and Mathematics are also strong suits, with 92.0% and 94.0% accuracy respectively. Instruction Following (71.0% accuracy) and Reasoning (80.0% accuracy) show solid, though not top-tier, performance. Email Classification is competent at 98.0% accuracy. Its primary strength lies in its ability to handle complex tasks reliably and quickly, making it well-suited for agentic workflows and coding.