DeepSeek: Deepseek R1 0528 Qwen3 8B

DeepSeek: Deepseek R1 0528 Qwen3 8B demonstrates moderate speed performance, ranking in the 31st percentile, indicating it is not among the fastest models available. However, it offers generally cost-effective solutions, placing in the 63rd percentile for price competitiveness. A standout feature is its exceptional reliability, achieving a perfect 100% success rate across all benchmarks, signifying consistent and dependable operation. In terms of benchmark performance, the model exhibits a mixed profile. It shows strong capabilities in Reasoning (98% accuracy, 96th percentile), where it is noted as the most accurate model at its price point. It also achieves perfect accuracy in General Knowledge (100%), ranking among the top 3 and being the most accurate among models of comparable speed and price. Coding performance is solid at 89% accuracy (75th percentile). However, its Instruction Following capabilities are less consistent, with accuracies of 50% and 41%, and notably high durations, indicating a potential area for improvement in processing complex instructions efficiently. Ethics and Email Classification show moderate accuracy at 98% and 95% respectively, though their percentile rankings are lower. Overall, its key strengths lie in complex reasoning and general knowledge, while speed and nuanced instruction following present opportunities for enhancement.