Cohere: Command R+ (04-2024)

Cohere's Command R+ (04-2024) model, released on April 1, 2024, demonstrates a strong overall performance profile, particularly in reliability and speed. It performs among the fastest models, ranking in the 64th percentile for speed across seven benchmarks. Its pricing is moderate, placing it in the 21st percentile. Notably, Command R+ exhibits exceptional reliability, achieving a 100% success rate across all benchmarks, indicating consistent and usable responses without technical failures. In terms of specific capabilities, the model excels in minimizing hallucinations, achieving 98.0% accuracy in identifying fictional concepts, and performs well in Email Classification (98.0% accuracy). It also shows strong performance in Ethics (97.0% accuracy). However, its performance in General Knowledge (92.5% accuracy) is average, and it struggles with more complex tasks such as Instruction Following (43.0% accuracy) and Reasoning (28.0% accuracy), where it ranks in the lower percentiles. Coding performance is also moderate at 74.0% accuracy. Command R+ is well-suited for applications requiring high reliability and speed, especially in areas like RAG and general consumer use cases, but may require further refinement for highly complex reasoning or multi-step instruction following.