Mistral: Devstral 2 2512

Mistral's Devstral 2 2512 model, released December 9, 2025, is a 123B-parameter dense transformer specializing in agentic coding with a 256K context window. It consistently ranks among the fastest models and offers highly competitive pricing, placing in the Infinityth percentile for both speed and cost across five benchmarks. The model demonstrates exceptional reliability with a 99% success rate, indicating minimal technical failures. In terms of performance, Devstral 2 exhibits a significant strength in its core domain, achieving 88.0% accuracy in the Coding benchmark, placing it in the 63rd percentile. It also performs well in General Knowledge with 98.5% accuracy (60th percentile) and Instruction Following at 62.0% accuracy (67th percentile). A notable weakness is its 0.0% accuracy in the Hallucinations (Baseline) test, suggesting it does not appropriately acknowledge uncertainty when presented with fictional concepts. Its Ethics performance is moderate at 96.0% accuracy (28th percentile), but with a very long duration. Overall, Devstral 2 excels in coding-related tasks and general knowledge, while its ability to identify and defer on fictional information requires improvement.