Amazon: Nova Micro 1.0

Amazon Nova Micro 1.0 consistently performs among the fastest models, ranking in the 84th percentile across various benchmarks. It also offers highly competitive pricing, placing in the 89th percentile. The model demonstrates strong reliability with an 82% success rate, indicating consistent delivery of usable responses. In terms of performance across categories, Nova Micro 1.0 shows a notable strength in acknowledging uncertainty, achieving 94% accuracy in hallucination tests. It also performs well in ethics (98% accuracy) and coding (82% accuracy). However, its performance in general knowledge (95% accuracy) and mathematics (39% accuracy) is average to below average compared to other models. Significant weaknesses are observed in instruction following (14% accuracy) and complex reasoning (2% accuracy), where it ranks in the lower percentiles. While its speed and cost efficiency are excellent across the board, the duration for general knowledge and ethics benchmarks was notably high.