Models/Meta/Llama 3.1 70B Instruct

Llama 3.1 70B Instruct

Meta · Open weights · Released Jul 23, 2024 · meta-llama/llama-3.1-70b-instruct
Best $0.72 in / $0.72 out via Amazon Bedrock
CompareEstimate cost
131K contextToolsOpen weights
Available from 1 providerUSD / MTOK · PRICES 16 MINUTES AGO · SPEED 20 DAYS AGO
EST. MONTHLY COSTclick a row for detail · click headers to sort
PROVIDERINPUTOUTPUTCACHECONTEXTQUANTTTFTTPSUPTIME
TTFT/TPS: median (P50) over trailing 504h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · methodology v1.1 · measured 20 days ago
SERVE THIS MODEL AND NOT LISTED? LIST YOUR INFERENCE →
Recent changesRSS ↗
Nov 4, 2026endpoint removed · deepinfra2 → 1
About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Specifications
Context window131,072
Max output8,192
Modalities intext
Modalities outtext
LicenseOpen weights
ReleasedJul 23, 2024
Knowledge cutoff2023-12-31
TokenizerLlama3
Open weightsGATED
Downloads90.7K
Likes1K
Licensellama3.1
safetensorspytorch
Embed badge
Llama 3.1 70B Instruct price and speed badge
[![Llama 3.1 70B Instruct](https://modelindex.ai/badge/meta-llama/llama-3.1-70b-instruct)](https://modelindex.ai/models/meta-llama/llama-3.1-70b-instruct)
Sources
OpenRouter API16 minutes ago
AGGREGATOR
Hugging Face16 minutes ago
COMMUNITY
ModelIndex benchmarks20 days ago
MEASURED
Verified 16 minutes ago · list prices, not negotiated rates.