Meta: Llama 3 70B Instruct

Text input Text output
Author's Description

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...

Key Specifications
Cost
$$
Context
8K
Parameters
70B
Released
Apr 17, 2024
Speed
Ability
Reliability
Supported Parameters

This model supports the following parameters:

Seed Tools Frequency Penalty Top P Min P Response Format Temperature Stop Presence Penalty Tool Choice Max Tokens
Features

This model supports the following features:

Response Format Tools
Performance Summary

Meta's Llama 3 70B Instruct model, released on April 17, 2024, demonstrates strong performance optimized for high-quality dialogue use cases. It consistently ranks among the fastest models and offers highly competitive pricing across various benchmarks. The model exhibits exceptional accuracy in Ethics (100%), achieving perfect scores and being the most accurate at its price point and speed. It also performs very well in Hallucinations (98.0%) and Email Classification (99.0%), indicating strong capabilities in discerning factual information and categorizing content. However, Llama 3 70B Instruct shows significant weaknesses in Mathematics (14.0% accuracy) and Coding (0.0% accuracy), suggesting these areas require further development. Its General Knowledge (94.5%), Instruction Following (51.0%), and Reasoning (44.0%) capabilities are moderate, with Reasoning notably being among the top 3 in speed. Overall, the model excels in ethical considerations, content classification, and avoiding hallucinations, making it a robust choice for dialogue-centric applications, while its speed and cost-effectiveness are significant advantages.

Model Pricing

Current Pricing

Feature Price (per 1M tokens)
Prompt $0.51
Completion $0.74

Price History

Available Endpoints
Provider Endpoint Name Context Length Pricing (Input) Pricing (Output)
DeepInfra
DeepInfra | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Hyperbolic
Hyperbolic | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Novita
Novita | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Groq
Groq | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Together
Together | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Novita
Novita | meta-llama/llama-3-70b-instruct 8K $0.51 / 1M tokens $0.74 / 1M tokens
Benchmark Results
Benchmark Category Reasoning Strategy Free Executions Accuracy Cost Duration
Other Models by meta-llama