NVIDIA: Nemotron 3 Super

NVIDIA Nemotron 3 Super demonstrates competitive response times, ranking in the 53rd percentile for speed across various benchmarks. Its pricing is moderate, placing it in the 37th percentile. Notably, the model exhibits exceptional reliability with a 98% success rate, indicating minimal technical failures and consistent evaluable responses. In terms of performance across categories, Nemotron 3 Super shows a significant strength in Reasoning, achieving 94.0% accuracy (80th percentile), and strong ethical understanding with 99.0% accuracy (53rd percentile). Its Mathematics performance is also solid at 83.0% accuracy (40th percentile). However, the model struggles with Instruction Following (33.0% accuracy, 28th percentile) and Email Classification (89.0% accuracy, 11th percentile), suggesting areas for improvement in precise directive execution and nuanced categorization. Hallucination rates are moderate at 86.0% accuracy (31st percentile), indicating some room for improvement in acknowledging uncertainty. Its Coding and General Knowledge capabilities are average, at 80.0% and 91.5% accuracy respectively, both falling below the 40th percentile.