Amazon: Nova Pro 1.0

Amazon Nova Pro 1.0, released in December 2024, demonstrates a strong overall performance profile, particularly excelling in speed and reliability. It performs among the fastest models, typically ranking in the top tier for speed (79th percentile across 8 benchmarks), and offers competitive pricing (43rd percentile). The model exhibits exceptional reliability with a 94% success rate, indicating consistent and usable responses. Nova Pro 1.0 shows particular strength in classification tasks, achieving 99.0% accuracy in Email Classification (83rd percentile). It also performs well in ethics and general knowledge, with 99.0% and 98.0% accuracy respectively, and demonstrates a high ability to acknowledge uncertainty, scoring 96.0% on the Hallucinations benchmark. However, the model shows notable weaknesses in Mathematics (42.0% accuracy, 17th percentile) and Reasoning (48.0% accuracy, 26th percentile), suggesting areas for improvement in complex problem-solving. While its coding performance is average (84.0% accuracy, 49th percentile), its instruction following is moderate at 55.0% accuracy.