Amazon: Nova Pro 1.0

Amazon Nova Pro 1.0, released in December 2024, is a capable multimodal model from Amazon, designed for a balance of accuracy, speed, and cost. It performs among the fastest models, ranking in the 78th percentile for speed, and offers moderate pricing, placing in the 38th percentile. The model demonstrates strong reliability with a 94% success rate across benchmarks, indicating consistent operational stability. Nova Pro 1.0 exhibits strong performance in specific areas. It achieves state-of-the-art results in visual question answering (TextVQA) and video understanding (VATEX), although video input is currently unsupported. Benchmark results show excellent accuracy in Email Classification (99.0%, 82nd percentile) and strong performance in Ethics (99.0%, 56th percentile) and General Knowledge (98.0%, 57th percentile). Its ability to appropriately acknowledge uncertainty is also notable, with a 96.0% accuracy in Hallucinations. However, the model shows notable weaknesses in complex cognitive tasks. Its performance in Mathematics (42.0% accuracy, 21st percentile) and Reasoning (48.0% accuracy, 31st percentile) is below average. Instruction Following (55.0% accuracy, 57th percentile) and Coding (84.0% accuracy, 56th percentile) are average. Nova Pro 1.0's strengths lie in its multimodal capabilities, classification accuracy, and ethical considerations, while areas like advanced mathematical and abstract reasoning present opportunities for future development.