Models/Meta/Llama 3.1 70B Instruct

Llama 3.1 70B Instruct

Name: Llama 3.1 70B Instruct API access
Brand: Meta

Meta · Open weights · Released Jul 23, 2024 · meta-llama/llama-3.1-70b-instruct

Best $0.40 in / $0.40 out via DeepInfra · fp8

Compare Estimate cost

131K contextToolsStructured outputOpen weights

Available from 2 providersUSD / MTOK · PRICES 23 MINUTES AGO · SPEED 14 DAYS AGO

EST. MONTHLY COSTclick a row for detail · click headers to sort

PROVIDER	INPUT	OUTPUT	CACHE	CONTEXT	QUANT	TTFT	TPS	UPTIME
DeepInfra	$0.40	$0.40	—	131K	fp8	1.5s	41 tok/s	89.4%
Amazon Bedrock	$0.72	$0.72	—	131K	—	1.2s	88 tok/s	100.0%

TTFT/TPS: median (P50) over trailing 504h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · methodology v1.1 · measured 14 days ago

SERVE THIS MODEL AND NOT LISTED? LIST YOUR INFERENCE →

Recent changesRSS ↗

Sep 5, 2026endpoint removed · coreweave3 → 2

About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Specifications

Context window131,072

Max output16,384

Modalities intext

Modalities outtext

LicenseOpen weights

ReleasedJul 23, 2024

Knowledge cutoff2023-12-31

TokenizerLlama3

WeightsHugging Face ↗

Open weightsGATED

Hugging Facemeta-llama/Llama-3.1-70B-Instruct ↗

Downloads88.9K

Likes1K

Licensellama3.1

safetensorspytorch

Llama Guard 4 12B$0.18 / $0.18 Llama 4 Maverick$0.188 / $0.652 Llama 4 Scout$0.10 / $0.30 Llama 3.3 70B Instruct$0.10 / $0.32

Embed badge

Llama 3.1 70B Instruct price and speed badge

[![Llama 3.1 70B Instruct](https://modelindex.ai/badge/meta-llama/llama-3.1-70b-instruct)](https://modelindex.ai/models/meta-llama/llama-3.1-70b-instruct)

Sources

OpenRouter API23 minutes ago

AGGREGATOR

Hugging Face23 minutes ago

COMMUNITY

ModelIndex benchmarks17 days ago

MEASURED

Verified 23 minutes ago · list prices, not negotiated rates.