Baidu: ERNIE 4.5 VL 28B A3B

Baidu's ERNIE 4.5 VL 28B A3B demonstrates competitive response times, performing in the 55th percentile for speed across various benchmarks. It also offers cost-effective solutions, ranking in the 65th percentile for price. Notably, the model exhibits exceptional reliability with a 100% success rate, consistently providing usable responses without technical failures. In terms of performance across categories, ERNIE 4.5 VL 28B A3B shows a standout strength in Ethics, achieving perfect 100% accuracy, making it the most accurate model at its price point and among models of similar speed. It also performs well in General Knowledge and Email Classification with 96% accuracy in both. However, a notable weakness is observed in its Hallucinations benchmark, where it scores 80% accuracy, indicating some difficulty in acknowledging uncertainty with fictional concepts. Instruction Following (56% accuracy), Coding (82% accuracy), and Reasoning (70% accuracy) show moderate performance. Its innovative heterogeneous MoE structure and RLVR alignment contribute to its strong cross-modal reasoning and generation capabilities, particularly evident in its ethical understanding.