Llama 3.1 70B Instruct
Meta · Open weights · Released Jul 23, 2024 · meta-llama/llama-3.1-70b-instruct
Best $0.72 in / $0.72 out via Amazon Bedrock
131K contextToolsOpen weights
Available from 1 providerUSD / MTOK · PRICES 16 MINUTES AGO · SPEED 20 DAYS AGO
EST. MONTHLY COSTclick a row for detail · click headers to sort
| PROVIDER | INPUT | OUTPUT | CACHE | CONTEXT | QUANT | TTFT | TPS | UPTIME |
|---|---|---|---|---|---|---|---|---|
| $0.72 | $0.72 | — | 131K | — | 1.3s | 80 tok/s | 100.0% |
TTFT/TPS: median (P50) over trailing 504h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · methodology v1.1 · measured 20 days ago
SERVE THIS MODEL AND NOT LISTED? LIST YOUR INFERENCE →
Recent changesRSS ↗
Nov 4, 2026endpoint removed · deepinfra2 → 1
About
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Specifications
Context window131,072
Max output8,192
Modalities intext
Modalities outtext
LicenseOpen weights
ReleasedJul 23, 2024
Knowledge cutoff2023-12-31
TokenizerLlama3
WeightsHugging Face ↗
Open weightsGATED
safetensorspytorch
Related
Embed badge
[](https://modelindex.ai/models/meta-llama/llama-3.1-70b-instruct)Sources
OpenRouter API16 minutes ago
AGGREGATORHugging Face16 minutes ago
COMMUNITYModelIndex benchmarks20 days ago
MEASUREDVerified 16 minutes ago · list prices, not negotiated rates.