Qwen: Qwen3 Coder 480B A35B

Qwen3 Coder 480B A35B demonstrates moderate speed performance, ranking in the 36th percentile across benchmarks, and offers competitive pricing, placing in the 54th percentile. A significant strength is its exceptional reliability, achieving a 97% success rate, indicating minimal technical failures. The model exhibits strong performance in agentic coding tasks, as evidenced by its 88.0% accuracy in the Coding (Baseline) benchmark, placing it in the 67th percentile. It also shows robust capabilities in Instruction Following (65.4% accuracy, 72nd percentile) and Reasoning (83.3% accuracy, 74th percentile), suggesting proficiency in complex problem-solving and adherence to directives. While its Email Classification accuracy is high at 98.0% (59th percentile), its Keyword Topic Relevance Classification is average at 90.0% (48th percentile). A notable weakness appears in Mathematics, where it scores 77.8% accuracy, ranking in the 40th percentile, and exhibits a particularly long duration for this task. Overall, the model is well-suited for its intended purpose of agentic coding, balancing competitive pricing with high reliability and strong performance in key coding and reasoning domains.