TheDrummer: UnslopNemo 12B

TheDrummer: UnslopNemo 12B, created on November 8, 2024, and designed for adventure writing and role-play, demonstrates moderate speed performance, ranking in the 21st percentile across seven benchmarks. It offers competitive pricing, placing in the 59th percentile. Notably, the model exhibits exceptional reliability with a 97% success rate, indicating minimal technical failures and consistent provision of evaluable responses. In terms of specific performance, UnslopNemo 12B shows a mixed profile. Its strongest area appears to be email classification, achieving 95.0% accuracy, and ethics, with 94.0% accuracy, though both are in the lower percentiles for their respective categories. A significant strength is its ability to acknowledge uncertainty, scoring 74.0% accuracy on hallucination tests. However, the model struggles considerably with complex reasoning, achieving only 20.4% accuracy (13th percentile), and instruction following, with 39.0% accuracy. General knowledge (87.5% accuracy) and coding (67.0% accuracy) also fall into the lower percentiles. Its duration for general knowledge, reasoning, and coding benchmarks is notably high, indicating slower processing for these complex tasks.