OpenAI: GPT-3.5 Turbo 16k

Text input Text output
Author's Description

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.

Key Specifications
Cost
$$$$$
Context
16K
Parameters
175B
Released
Aug 27, 2023
Speed
Ability
Reliability
Supported Parameters

This model supports the following parameters:

Tool Choice Top P Logit Bias Temperature Logprobs Presence Penalty Stop Response Format Structured Outputs Tools Max Tokens Frequency Penalty Top Logprobs Seed
Features

This model supports the following features:

Response Format Tools Structured Outputs
Performance Summary

OpenAI's GPT-3.5 Turbo 16k, released on August 27, 2023, offers a significantly extended context length of 16385 tokens, four times that of its predecessor, supporting approximately 20 pages of text per request. This model consistently performs among the fastest available, ranking in the 97th percentile across two benchmarks. While its pricing is moderate, placing it in the 22nd percentile, it demonstrates exceptional reliability with a perfect 100% success rate across all evaluated benchmarks, indicating minimal technical failures. In terms of benchmark performance, the model achieved 95.5% accuracy in the General Knowledge (Baseline) test, positioning it in the 43rd percentile for accuracy, with a cost of $0.1647 and a duration of 151465ms. For the Ethics (Baseline) benchmark, it scored 99.0% accuracy, ranking in the 53rd percentile, at a cost of $0.1111 and a duration of 85053ms. A key strength is its remarkable speed and outstanding reliability, ensuring consistent and timely responses. Its extended context window is also a significant advantage for complex, long-form tasks. While its accuracy in general knowledge is average, its ethical reasoning performance is solid. The primary weakness is its moderate pricing, which is not as competitive as some alternatives.

Model Pricing

Current Pricing

Feature Price (per 1M tokens)
Prompt $3
Completion $4

Price History

Available Endpoints
Provider Endpoint Name Context Length Pricing (Input) Pricing (Output)
OpenAI
OpenAI | openai/gpt-3.5-turbo-16k 16K $3 / 1M tokens $4 / 1M tokens
Azure
Azure | openai/gpt-3.5-turbo-16k 16K $3 / 1M tokens $4 / 1M tokens
Benchmark Results
Benchmark Category Reasoning Strategy Free Executions Accuracy Cost Duration
Other Models by openai