OpenAI: GPT-4o-mini

Image input File input Text input Text output
Author's Description

GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than [GPT-3.5 Turbo](/models/openai/gpt-3.5-turbo). It maintains SOTA intelligence, while being significantly more cost-effective. GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences [common leaderboards](https://arena.lmsys.org/). Check out the [launch announcement](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) to learn more. #multimodal

Key Specifications
Cost
$$
Context
128K
Parameters
8B (Rumoured)
Released
Jul 17, 2024
Speed
Ability
Reliability
Supported Parameters

This model supports the following parameters:

Logit Bias Tool Choice Seed Top P Top Logprobs Temperature Response Format Logprobs Max Tokens Presence Penalty Structured Outputs Tools Frequency Penalty Stop
Features

This model supports the following features:

Structured Outputs Response Format Tools
Performance Summary

GPT-4o-mini demonstrates strong overall performance, consistently ranking among the fastest models with an 81st percentile across benchmarks. It offers competitive pricing, typically providing cost-effective solutions at the 74th percentile. Notably, its reliability is exceptional, achieving a perfect 100th percentile, indicating minimal technical failures and consistent response delivery. Across benchmark categories, GPT-4o-mini exhibits significant strengths. It excels in Coding (87.0% accuracy), demonstrating high accuracy and being the most accurate among models of comparable speed. Its performance in General Knowledge (99.5% accuracy) and Ethics (100.0% accuracy) is outstanding, with the latter achieving perfect accuracy and being the most accurate at its price point and speed. While strong in Classification (98.0% accuracy), its Instruction Following (61.0% accuracy) and Reasoning (54.0% accuracy) scores are more moderate, with Reasoning being a relative weakness at the 42nd percentile. Overall, GPT-4o-mini stands out for its blend of high accuracy in key areas, cost-efficiency, and remarkable reliability, making it a compelling option for a wide range of applications.

Model Pricing

Current Pricing

Feature Price (per 1M tokens)
Prompt $0.15
Completion $0.6
Input Cache Read $0.075

Price History

Available Endpoints
Provider Endpoint Name Context Length Pricing (Input) Pricing (Output)
OpenAI
OpenAI | openai/gpt-4o-mini 128K $0.15 / 1M tokens $0.6 / 1M tokens
Azure
Azure | openai/gpt-4o-mini 128K $0.15 / 1M tokens $0.6 / 1M tokens
Benchmark Results
Benchmark Category Reasoning Free Executions Accuracy Cost Duration
Other Models by openai