DeepSeek: DeepSeek R1 0528 Qwen3 8B

DeepSeek: Deepseek R1 0528 Qwen3 8B demonstrates moderate speed performance, ranking in the 25th percentile across benchmarks. It offers cost-effective solutions, placing in the 61st percentile for pricing. A standout feature is its exceptional reliability, achieving a 100% success rate with no technical failures. The model exhibits strong performance in several key areas. It achieved perfect accuracy in General Knowledge, notably being the most accurate model at its price point and among models of similar speed. Its Reasoning capabilities are also impressive, scoring 96.0% accuracy and ranking in the 89th percentile. Coding performance is solid at 89.0% accuracy. However, the model shows weaknesses in Hallucinations, with an 80.0% accuracy (24th percentile), indicating a tendency to provide answers rather than acknowledge uncertainty. Instruction Following also presents a mixed picture, with scores of 41.0% and 50.0% across two benchmarks, suggesting room for improvement in handling complex multi-step directives. Mathematics performance is respectable at 86.7%, though its duration for this benchmark is notably high.