OpenAI: GPT-3.5 Turbo Instruct

OpenAI's GPT-3.5 Turbo Instruct, created on September 27, 2023, and trained on data up to September 2021, is a variant of GPT-3.5 Turbo specifically tuned for instructional prompts. This model consistently performs among the fastest models, ranking in the 81st percentile for speed across five benchmarks. It offers moderate pricing, placing in the 33rd percentile for cost. A significant strength is its exceptional reliability, demonstrating minimal technical failures and ranking in the 99th percentile. In terms of benchmark performance, the model shows varied capabilities. It achieved 71.0% accuracy in Coding (Baseline) and 38.0% in Instruction Following (Baseline), both ranking in the 37th percentile for accuracy. Its Reasoning (Baseline) performance was 39.0% accuracy, placing it in the 25th percentile. However, it demonstrated strong performance in Ethics (Baseline) with 97.0% accuracy (35th percentile) and General Knowledge (Baseline) with 93.5% accuracy (42nd percentile). While its speed is a consistent advantage across all benchmarks, its accuracy in complex reasoning and instruction following tasks appears to be a notable weakness. Its strengths lie in its high reliability, speed, and solid performance in general knowledge and ethical reasoning.