Qwen: Qwen3 Coder 30B A3B Instruct

Qwen3 Coder 30B A3B Instruct demonstrates a balanced performance profile, excelling in specific areas while showing room for improvement in others. It performs among the fastest models, ranking in the 67th percentile for speed across benchmarks, and offers competitive pricing, placing in the 75th percentile. Its reliability is notably high, with a 92% success rate, indicating consistent and stable operation. The model exhibits exceptional performance in "Keyword Topic Relevance Classification" with perfect accuracy, making it the most accurate and cost-effective model in this category. It also shows strong capabilities in "Coding" (89% accuracy, 71st percentile) and "Mathematics" (89% accuracy, 63rd percentile), aligning with its design for code generation and structured tasks. "Reasoning" is another strength, achieving 78% accuracy (68th percentile). However, a significant weakness is observed in "General Knowledge," where it scores only 32.2% accuracy (14th percentile). Its "Hallucinations (Baseline)" accuracy is 94%, which is average (48th percentile), suggesting occasional instances of generating unverified information. "Instruction Following" and "Email Classification" also present areas for improvement, with 51.5% and 91% accuracy respectively, placing them in lower percentiles.