Qwen: QwQ 32B

Qwen: QwQ 32B, a medium-sized reasoning model from the Qwen series, demonstrates exceptional speed, consistently ranking among the fastest models with an Infinityth percentile across nine benchmarks. Its pricing is competitive, placing it in the 52nd percentile across eight benchmarks. Furthermore, QwQ 32B exhibits outstanding reliability, boasting a 99% success rate across nine benchmarks, indicating minimal technical failures. In terms of performance across categories, QwQ 32B shows significant strengths in complex reasoning tasks, achieving 98.0% accuracy (93rd percentile) in the Reasoning benchmark. It also excels in Ethics, reaching a perfect 100.0% accuracy, making it the most accurate model at its price point and among models of comparable speed. Mathematics is another strong area, with 95.9% accuracy (91st percentile). General Knowledge and Email Classification also show robust performance at 99.0% and 98.0% accuracy respectively. While its Coding accuracy is respectable at 91.0% (70th percentile), a notable weakness is observed in Hallucinations, where it achieved 86.0% accuracy (31st percentile), suggesting room for improvement in acknowledging uncertainty. Instruction Following presents a mixed picture, with one benchmark showing 53.0% accuracy and another indicating 0.0%, which warrants further investigation. Overall, QwQ 32B is a highly reliable and fast model with strong reasoning and ethical capabilities.