NVIDIA: Nemotron Nano 12B 2 VL

NVIDIA's Nemotron Nano 12B 2 VL, a 12-billion-parameter multimodal model, demonstrates exceptional speed, consistently ranking among the fastest models, and offers highly competitive pricing. Its reliability is strong, with a 91% success rate across benchmarks. Designed for video understanding and document intelligence, it leverages a hybrid Transformer-Mamba architecture for high throughput and low latency. The model exhibits significant strengths in knowledge-based tasks, achieving 99.5% accuracy in General Knowledge and a perfect 100.0% in Ethics, where it is noted as the most accurate model at its price point and among models of similar speed. It also performs well in Reasoning (94.0%) and Email Classification (98.0%). However, Nemotron Nano 2 VL shows notable weaknesses in Instruction Following, scoring 0.0% accuracy, and struggles with Coding (65.6%) and Mathematics (52.6%). Its performance on Hallucinations (80.0%) suggests room for improvement in acknowledging uncertainty. Despite these areas for development, its leading results on OCRBench v2 and strong average across various multimodal benchmarks highlight its specialized capabilities.