TheDrummer: UnslopNemo 12B

TheDrummer: UnslopNemo 12B, created on November 8, 2024, and designed for adventure writing and role-play, demonstrates moderate speed performance, ranking in the 23rd percentile. It offers cost-effective solutions, placing in the 61st percentile for price. Notably, the model exhibits exceptional reliability with a 97% success rate, indicating minimal technical failures. Across benchmarks, UnslopNemo 12B shows a mixed performance. Its strongest area is Ethics, achieving 94.0% accuracy, and Email Classification at 95.0% accuracy, suggesting proficiency in understanding and categorizing nuanced content. It also performs reasonably well in General Knowledge (87.5%) and Coding (67.0%). However, the model struggles significantly with complex Reasoning, scoring only 20.4% accuracy, and Instruction Following, with 39.0% accuracy. Its ability to acknowledge uncertainty (Hallucinations baseline) is moderate at 74.0%. While generally cost-effective, its duration for General Knowledge and Reasoning benchmarks is notably high, indicating slower processing for these complex tasks.