OpenAI: GPT-4 (older v0314)

GPT-4-0314, released on May 27, 2023, with a context length of 8191 tokens and training data up to September 2021, consistently ranks among the fastest models available, demonstrating exceptional speed across various benchmarks. However, it is positioned at a premium pricing level, reflecting its advanced capabilities. The model exhibits outstanding reliability, achieving a perfect 100th percentile, indicating minimal technical failures and consistent provision of usable responses. In terms of benchmark performance, GPT-4-0314 shows strong instruction following capabilities, achieving 68.0% accuracy in the "Instruction Following (Baseline)" test, placing it in the 82nd percentile. This test, which evaluates precision across complex multi-layered instructions, highlights a key strength. While its cost for instruction following was in the 5th percentile ($0.8061), its duration was moderate. Notably, the model registered 0.0% accuracy in both "Reasoning (Baseline)" and "General Knowledge (Baseline)" benchmarks. This suggests significant limitations in these specific areas, despite its overall advanced nature. Its key strengths lie in its speed, reliability, and robust instruction following, while its primary weaknesses appear to be in complex reasoning and broad general knowledge recall as measured by these specific benchmarks.