OpenAI: GPT-3.5 Turbo 16k

Text input Text output
Author's Description

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.

Key Specifications
Cost
$$$$$
Context
16K
Parameters
175B
Released
Aug 27, 2023
Speed
Ability
Reliability
Supported Parameters

This model supports the following parameters:

Top Logprobs Stop Structured Outputs Logprobs Presence Penalty Frequency Penalty Top P Max Tokens Tool Choice Response Format Logit Bias Seed Temperature Tools
Features

This model supports the following features:

Response Format Tools Structured Outputs
Performance Summary

OpenAI's GPT-3.5 Turbo 16k, released on August 27, 2023, is a significant advancement with a context length four times that of its predecessor, supporting approximately 20 pages of text. This model consistently performs among the fastest, ranking in the 97th percentile across two benchmarks. It offers moderate pricing, placing in the 21st percentile, and demonstrates exceptional reliability with a 100% success rate across two benchmarks, indicating minimal technical failures. In terms of benchmark performance, the model achieved 95.5% accuracy in General Knowledge, placing it in the 43rd percentile, with a cost of $0.1647 and a duration of 151465ms. For Ethics, it scored 99.0% accuracy, ranking in the 52nd percentile, at a cost of $0.1111 and a duration of 85053ms. Key strengths include its high reliability, impressive speed, and significantly extended context window, making it suitable for complex, long-form tasks. While its accuracy in general knowledge is solid, it doesn't stand out as a top performer in this specific area compared to some other models. Its moderate pricing positions it as a cost-effective option for its capabilities.

Model Pricing

Current Pricing

Feature Price (per 1M tokens)
Prompt $3
Completion $4

Price History

Available Endpoints
Provider Endpoint Name Context Length Pricing (Input) Pricing (Output)
OpenAI
OpenAI | openai/gpt-3.5-turbo-16k 16K $3 / 1M tokens $4 / 1M tokens
Azure
Azure | openai/gpt-3.5-turbo-16k 16K $3 / 1M tokens $4 / 1M tokens
Benchmark Results
Benchmark Category Reasoning Strategy Free Executions Accuracy Cost Duration
Other Models by openai