Noromaid 20B

Noromaid 20B, a collaboration between IkariDev and Undi, demonstrates exceptional performance in terms of operational efficiency. It consistently ranks among the fastest models available and offers highly competitive pricing, placing it in the Infinityth percentile for both speed and cost across eight benchmarks. This makes it a very attractive option for cost-sensitive and high-throughput applications. However, the model's accuracy across various benchmarks indicates significant limitations in its current capabilities. While it achieves a respectable 94.0% accuracy in Email Classification, suggesting a strength in contextual understanding for specific categorization tasks, its performance in other areas is notably low. It struggles significantly with General Knowledge (0.5% accuracy), Ethics (10.0% accuracy), Instruction Following (2.0% accuracy), and Coding (5.0% accuracy). Furthermore, it scored 0.0% accuracy in both Mathematics and Reasoning, indicating a fundamental weakness in complex problem-solving and logical deduction. Its 44.0% accuracy in Hallucinations suggests it sometimes struggles to appropriately acknowledge uncertainty. Overall, Noromaid 20B excels in operational efficiency but requires substantial improvement in its core intellectual capabilities for general-purpose applications.