Qwen: Qwen3 VL 235B A22B Thinking

Qwen3-VL-235B-A22B Thinking consistently ranks among the fastest models and offers highly competitive pricing across various benchmarks. This multimodal model, designed for strong text generation and visual understanding, demonstrates particular strength in Instruction Following, achieving 81.6% accuracy (93rd percentile), indicating a robust ability to process and execute complex directives. Its Email Classification performance is also strong at 97.8% accuracy (51st percentile), showcasing effective contextual understanding. The model exhibits a reasonable ability to acknowledge uncertainty, with 95.2% accuracy in the Hallucinations benchmark (51st percentile). However, significant weaknesses are apparent in core cognitive areas. Performance in Coding, General Knowledge, and Ethics benchmarks is 0.0% accuracy, suggesting a complete inability to address these types of questions. Reasoning and Mathematics also show very low accuracy at 3.4% (5th percentile) and 3.1% (9th percentile) respectively, indicating substantial limitations in complex problem-solving and quantitative analysis. While optimized for multimodal reasoning in STEM and math, the benchmark results do not reflect this specialization in the tested categories. The model's strengths lie in its operational efficiency and specific classification/instruction adherence rather than broad knowledge or advanced reasoning.