Qwen: Qwen3.5-27B

Qwen3.5-27B, a vision-language model from qwen, demonstrates exceptional speed and cost-efficiency. It consistently ranks among the fastest models, achieving an Infinityth percentile in speed across 8 benchmarks, and offers highly competitive pricing, also at an Infinityth percentile across 4 benchmarks. The model exhibits strong reliability with an 88% success rate across 8 benchmarks, indicating few technical issues. In terms of specific performance, Qwen3.5-27B shows a notable strength in Email Classification, achieving 98.0% accuracy, placing it in the 52nd percentile, with very low cost and duration. Its Hallucinations (Baseline) performance is also strong at 94.0% accuracy, suggesting a good ability to acknowledge uncertainty. Instruction Following is another area of strength, with 80.0% accuracy, ranking in the 89th percentile. However, the model currently shows significant weaknesses in several core areas, including General Knowledge, Coding, Reasoning, Ethics, and Mathematics, where it recorded 0.0% accuracy across all these benchmarks. This suggests that while it excels in specific tasks and operational efficiency, its general cognitive and problem-solving capabilities require substantial development.