Toppy M 7B

Toppy M 7B, a 7B parameter model from undi95, demonstrates moderate speed performance, ranking in the 29th percentile across five benchmarks. It offers competitive pricing, placing in the 45th percentile. The model exhibits notable weaknesses in accuracy across most evaluated categories. In General Knowledge, it achieved only 16.3% accuracy (12th percentile), and in Ethics, it scored 28.0% (12th percentile). Its performance in Coding was particularly low at 2.0% accuracy (8th percentile). While it showed a relatively better accuracy of 92.0% in Email Classification, this still places it in the 20th percentile. Instruction Following also presented a challenge, with 31.1% accuracy (32nd percentile) and a particularly long duration. Overall, Toppy M 7B struggles with tasks requiring deep understanding and complex reasoning, but its competitive pricing might be a consideration for specific, less accuracy-critical applications.