Nous: Hermes 4 405B

Nous: Hermes 4 405B, built on Meta-Llama-3.1-405B, demonstrates a balanced performance profile with exceptional reliability. It performs competitively in terms of speed, ranking in the 56th percentile across benchmarks, and offers moderate pricing, placing in the 34th percentile. Notably, the model achieves a perfect 100% success rate across all 8 benchmarks, indicating outstanding technical reliability with no reported failures. Hermes 4 excels in specific areas, achieving perfect accuracy in both Hallucinations (100.0%) and Ethics (100.0%) benchmarks, making it the most accurate model at its price point and speed for these categories. It also shows strong performance in General Knowledge (99.5%) and Email Classification (99.0%), ranking in the 77th and 81st percentiles respectively. Its instruction-tuned nature, with an expanded post-training corpus emphasizing reasoning traces, is evident in its solid 72.0% accuracy in Reasoning. While its Coding (83.0%) and Mathematics (79.0%) scores are respectable, they fall closer to the average compared to its top-tier performance in other areas. The model's hybrid reasoning mode and support for structured outputs like JSON mode and function calling further enhance its versatility.