Arcee AI: AFM 4.5B

Arcee AI's AFM-4.5B model demonstrates moderate speed performance, ranking in the 38th percentile across benchmarks. It offers cost-effective solutions, typically falling within the 68th percentile for price. Notably, the model exhibits exceptional reliability with a 99% success rate, indicating consistent and usable responses. In terms of performance across categories, AFM-4.5B shows a solid ability to acknowledge uncertainty, achieving 92.0% accuracy in hallucination detection. Its general knowledge is also strong at 95.0% accuracy. However, the model struggles significantly in more complex cognitive tasks. It shows weaknesses in Ethics (91.0% accuracy, 25th percentile), Mathematics (51.0% accuracy, 24th percentile), Instruction Following (22.7% accuracy, 26th percentile), and particularly in Reasoning (25.5% accuracy, 17th percentile). While its Coding performance is moderate at 66.3% accuracy, its Email Classification accuracy is low at 88.0% (12th percentile). Key strengths include its high reliability, cost-effectiveness, and proficiency in general knowledge and identifying fictional concepts. Its notable weaknesses lie in advanced reasoning, mathematical problem-solving, and precise instruction following, suggesting areas for further development.