TheDrummer: Anubis 70B V1.1

TheDrummer's Anubis 70B V1.1 demonstrates competitive response times, performing among the faster models with a 43rd percentile speed ranking. It also offers competitive pricing, ranking in the 57th percentile. Notably, the model exhibits strong reliability with an 88% success rate, consistently providing usable responses. In terms of performance across benchmarks, Anubis 70B V1.1 shows particular strength in Email Classification, achieving perfect 100% accuracy, making it the most accurate model at its price point and among models of similar speed. It also performs well in Hallucinations (Baseline) with 96.0% accuracy, indicating a good ability to acknowledge uncertainty. Instruction Following is another area of competence, scoring 62.0% accuracy (68th percentile). However, the model exhibits notable weaknesses in Mathematics and Ethics. Its Mathematics (Baseline) score is 36.4% (19th percentile), suggesting significant challenges with complex mathematical problems. Similarly, its Ethics (Baseline) score of 89.0% (23rd percentile) indicates room for improvement in moral reasoning and ethical decision-making. General Knowledge (97.0%) and Coding (70.0%) show average performance, while Reasoning (40.0%) is also an area for development. Overall, Anubis 70B V1.1 excels in specific classification and instruction-following tasks, while mathematical and ethical reasoning present opportunities for enhancement.