Qwen: Qwen3 Coder 480B A35B

Qwen3 Coder 480B A35B, a Mixture-of-Experts (MoE) model optimized for agentic coding, demonstrates competitive response times, ranking in the 40th percentile across six benchmarks. Its pricing is also competitive, placing it in the 57th percentile. Notably, the model exhibits exceptional reliability with a 97% success rate, indicating minimal technical failures and consistent evaluable responses. In terms of performance across categories, Qwen3 Coder 480B A35B shows strong capabilities in Classification tasks, achieving 90.0% accuracy in Keyword Topic Relevance and an impressive 98.0% in Email Classification. It also performs well in Instruction Following (65.4% accuracy) and Reasoning (83.3% accuracy), suggesting robust analytical and directive comprehension. As expected for a "Coder" model, it excels in the Coding benchmark with 88.0% accuracy. A notable weakness appears in Mathematics, where it scored 77.8% accuracy, placing it in the 33rd percentile, indicating this area might require further optimization. The model's strength lies in its specialized coding abilities and general classification tasks, while its long duration times in some benchmarks, particularly Reasoning and Mathematics, suggest areas for speed improvement.