Baidu: ERNIE 4.5 300B A47B

Baidu's ERNIE-4.5-300B-A47B demonstrates moderate speed performance, ranking in the 27th percentile across various benchmarks. However, it offers competitive pricing, typically providing cost-effective solutions and ranking in the 70th percentile. The model exhibits a notable strength in Coding, achieving 90.0% accuracy, placing it in the 81st percentile for this category. Its instruction following capabilities are also strong, with 68.0% accuracy, ranking in the 83rd percentile. These results suggest the model is well-suited for tasks requiring precise adherence to instructions and programming knowledge. Conversely, the model shows significant weaknesses in several areas. Its performance in Email Classification is very low at 29.0% accuracy (6th percentile), indicating a struggle with nuanced categorization. Similarly, Reasoning (16.0% accuracy, 11th percentile), Ethics (33.0% accuracy, 14th percentile), and General Knowledge (37.5% accuracy, 16th percentile) benchmarks reveal considerable limitations in complex problem-solving, ethical judgment, and broad factual recall. While its cost-effectiveness is a clear advantage, the model's inconsistent accuracy across different domains suggests it is best utilized for its strong coding and instruction-following capabilities rather than general-purpose reasoning or classification tasks.