OpenAI: GPT-4o-mini Search Preview

OpenAI's GPT-4o-mini Search Preview, created on March 12, 2025, is a specialized model designed for web search within Chat Completions, featuring a substantial 128,000 context length. This model consistently ranks among the fastest available, demonstrating exceptional speed across all evaluated benchmarks. It also offers highly competitive pricing, consistently placing in the Infinityth percentile for cost-effectiveness. Reliability is a significant strength, with a perfect 100% success rate across all 8 benchmarks, indicating minimal technical failures and consistent response delivery. In terms of performance across categories, the model shows strong capabilities in General Knowledge, Ethics, and Mathematics, achieving 99.0%, 99.0%, and 84.0% accuracy respectively. It also performs well in Reasoning (66.0%) and Coding (80.0%). A notable weakness is its performance in Hallucinations, with only 28.0% accuracy, suggesting it struggles to appropriately acknowledge uncertainty when presented with fictional concepts. The model also exhibited a critical failure in Instruction Following, achieving 0.0% accuracy, indicating a significant limitation in executing complex, multi-step instructions. Its Email Classification accuracy is moderate at 96.0%. Overall, its strengths lie in core knowledge and ethical reasoning, while areas for improvement include hallucination mitigation and instruction following.