MythoMax 13B

MythoMax 13B, a fine-tuned Llama 2 13B model known for rich descriptions and roleplay, demonstrates exceptional speed and competitive pricing. It consistently ranks among the fastest models and offers highly competitive pricing across all benchmarks. However, its performance on accuracy-based benchmarks is notably low across the board. In General Knowledge, it achieved only 0.3% accuracy, and in Ethics, 1.0%. Reasoning and Coding benchmarks also showed very low accuracy at 10.0% and 3.0% respectively. The model's best accuracy was in Email Classification at 86.0%, though this still places it in the 11th percentile. A significant weakness is its complete failure in Instruction Following, scoring 0.0% accuracy. While its cost-efficiency is high, particularly in Ethics and Reasoning, and its duration for tasks is generally moderate, the consistently low accuracy across diverse cognitive tasks suggests that MythoMax 13B is not suitable for applications requiring high factual correctness, ethical judgment, or precise instruction adherence. Its strengths appear to lie in its operational efficiency rather than its intellectual capabilities as measured by these benchmarks.