MythoMax 13B

MythoMax 13B, provided by gryphe, is a fine-tuned Llama 2 13B model known for rich descriptions and roleplay. It consistently ranks among the fastest models and offers highly competitive pricing across all benchmarks. However, its performance in accuracy across various benchmarks is notably low. In General Knowledge, it achieved only 0.3% accuracy (8th percentile), and in Ethics, it scored 1.0% (6th percentile). Instruction Following showed 0.0% accuracy, indicating a significant weakness in adhering to complex directives. Reasoning and Coding benchmarks also yielded very low accuracy at 10.0% (7th percentile) and 3.0% (9th percentile) respectively. The Email Classification benchmark, while still low, was its strongest at 86.0% accuracy (9th percentile), suggesting some capability in structured classification tasks. Despite its speed and cost efficiency, the model demonstrates substantial limitations in understanding, reasoning, and accurate response generation across a broad spectrum of tasks.