TheDrummer: Rocinante 12B

TheDrummer: Rocinante 12B, created on September 29, 2024, is designed for engaging storytelling and rich prose, featuring an expanded vocabulary and enhanced creativity. This model demonstrates competitive response times, ranking in the 46th percentile for speed across six benchmarks, and offers cost-effective solutions, placing in the 61st percentile for price. Notably, Rocinante 12B exhibits exceptional reliability with a 99% success rate, indicating minimal technical failures. In terms of performance across benchmarks, the model shows strong capabilities in Ethics (98.0% accuracy) and Email Classification (97.0% accuracy), suggesting proficiency in understanding nuanced scenarios and categorizing information. Its General Knowledge is fair at 92.0% accuracy, though it ranks in the lower 35th percentile. A significant weakness is observed in Reasoning (26.0% accuracy) and Instruction Following (36.0% accuracy), where its performance is considerably lower, ranking in the 18th and 35th percentiles respectively. Coding performance is moderate at 76.0% accuracy. Overall, Rocinante 12B's strengths lie in its reliability, cost-effectiveness, and ability to handle ethical and classification tasks, while its primary areas for improvement are complex reasoning and precise instruction following.