Microsoft: MAI DS R1

Microsoft's MAI-DS-R1, a post-trained variant of DeepSeek-R1, demonstrates a balanced performance profile with a strong emphasis on safety and reasoning. The model exhibits moderate speed performance, ranking in the 31st percentile, and offers moderate pricing, placing it in the 38th percentile. A standout feature is its exceptional reliability, boasting a 99% success rate across benchmarks, indicating minimal technical failures. MAI-DS-R1 excels in several key areas. It achieves perfect accuracy in General Knowledge, Ethics, and one of the Instruction Following benchmarks, with the latter also being a top performer in speed. Its Coding and Reasoning capabilities are highly competitive, scoring 95% and 98% accuracy respectively, placing it in the 96th and 94th percentiles. The model also performs well in Email Classification (99% accuracy). While its Hallucinations (Baseline) accuracy is 88.9%, placing it in the 34th percentile, this indicates some room for improvement in acknowledging uncertainty. Mathematics performance is solid at 90% accuracy. Overall, MAI-DS-R1 successfully unblocks previously restricted topics while maintaining strong core AI capabilities, making it suitable for general-purpose use cases.