Meta: Llama 3.2 90B Vision Instruct

Meta's Llama 3.2 90B Vision Instruct model demonstrates a strong overall performance profile, particularly excelling in reliability with an 84% success rate, indicating consistent and usable responses. In terms of speed, it generally performs in the top tier, ranking in the 63rd percentile, while offering competitive pricing at the 41st percentile. The model exhibits notable strengths in classification tasks, achieving 99.0% accuracy in Email Classification, placing it in the 80th percentile for that benchmark. It also performs well in Ethics (99.0% accuracy) and General Knowledge (97.5% accuracy), suggesting a robust understanding across diverse informational domains. However, its performance in Instruction Following (51.0% accuracy) and Reasoning (56.0% accuracy) is more moderate, indicating areas where further refinement could enhance its capabilities. A significant weakness is observed in the Coding benchmark, where it achieved only 6.0% accuracy, placing it in the 12th percentile. This suggests the model is not well-suited for programming-related tasks. Despite this, its high reliability and strong performance in visual and textual comprehension tasks make it a valuable asset for industries requiring advanced multimodal AI.