Nous: Hermes 4 70B

Nous: Hermes 4 70B, built on Meta-Llama-3.1-70B, demonstrates strong overall performance, particularly excelling in reliability with a 94% success rate, indicating consistent and usable responses. The model performs among the fastest models, ranking in the 69th percentile for speed, and offers competitive pricing, placing in the 74th percentile for cost-effectiveness. In terms of specific benchmarks, Hermes 4 70B shows notable strengths in Ethics (99.0% accuracy) and Email Classification (98.0% accuracy), suggesting robust performance in tasks requiring ethical judgment and precise categorization. General Knowledge also shows solid performance at 96.5% accuracy. However, the model exhibits weaknesses in Coding (26th percentile accuracy) and Reasoning (29th percentile accuracy), indicating areas for potential improvement in complex problem-solving and programming tasks. Instruction Following also presents a moderate challenge at 55.1% accuracy. Its hybrid reasoning mode and support for JSON, schema adherence, and function calling are key features enhancing its steerability and utility for structured outputs.