Cohere: Command R+

Cohere's Command R+ model, launched on April 3, 2024, demonstrates a strong overall performance profile. It performs among the fastest models, typically ranking in the top tier for speed (75th percentile across benchmarks). While its pricing is moderate (23rd percentile), it exhibits exceptional reliability, consistently providing usable responses with minimal technical failures (100th percentile). In terms of specific benchmarks, Command R+ excels in Email Classification with 99.0% accuracy, placing it in the 76th percentile, and shows strong performance in Ethics (97.0% accuracy) and General Knowledge (94.5% accuracy). However, its accuracy in Reasoning (35.0%) and Instruction Following (47.0%) is comparatively lower, ranking in the 21st and 46th percentiles respectively. Coding performance is also moderate at 72.0% accuracy. While its speed is generally high, some benchmarks like Reasoning and Coding show longer durations. Overall, Command R+ is a reliable and fast model, particularly strong in classification and general knowledge, though there are areas for improvement in complex reasoning and instruction following.