Models/Meta/Llama 3.1 8B Instruct

Llama 3.1 8B Instruct

Name: Llama 3.1 8B Instruct API access
Brand: Meta

Meta · Open weights · Released Jul 23, 2024 · meta-llama/llama-3.1-8b-instruct

Compare Estimate cost

131K contextToolsStructured outputPrompt cachingOpen weights

Available from 5 providersUSD / MTOK · VERIFIED 4 MINUTES AGO

EST. MONTHLY COSTclick a row for detail · click headers to sort

PROVIDER	INPUT	OUTPUT	CACHE	CONTEXT	QUANT	TTFT	TPS	SMOKE	UPTIME
DeepInfra	$0.02	$0.04	—	131K	fp8	1.1s	37 tok/s	3/5	99.8%
Novita	$0.02	$0.05	—	16K	fp8	0.61s	170 tok/s	4/5	99.7%
Groq	$0.05	$0.08	$0.025	131K	—	0.66s	507 tok/s	4/5	99.9%
Cloudflare	$0.152	$0.287	—	32K	fp8	2.7s	10 tok/s	3/5	98.5%
CWCoreWeave	$0.22	$0.22	$0.22	128K	bf16	0.42s	147 tok/s	4/5	100.0%

TTFT/TPS: median (P50) over trailing 72h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · SMOKE: of 5 programmatic capability probes passed (JSON schema, instruction following, tool call, long-context, benign compliance; retry-once) · screened via OpenRouter routing · v0.2 · methodology v1.1 · measured 44 hours ago

About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Specifications

Context window131,072

Max output131,072

Modalities intext

Modalities outtext

LicenseOpen weights

ReleasedJul 23, 2024

Knowledge cutoff2023-12-31

TokenizerLlama3

WeightsHugging Face ↗

Open weightsGATED

Hugging Facemeta-llama/Llama-3.1-8B-Instruct ↗

Downloads6.4M

Likes6.7K

Licensellama3.1

safetensorspytorch

Llama Guard 4 12B$0.18 / $0.18 Llama 4 Maverick$0.20 / $0.696 Llama 4 Scout$0.10 / $0.30 Llama 3.3 70B Instruct$0.10 / $0.32

Embed badge

Llama 3.1 8B Instruct price and speed badge

[![Llama 3.1 8B Instruct](https://modelindex.ai/badge/meta-llama/llama-3.1-8b-instruct)](https://modelindex.ai/models/meta-llama/llama-3.1-8b-instruct)

Sources

OpenRouter API4 minutes ago

AGGREGATOR

Hugging Face4 minutes ago

COMMUNITY

ModelIndex benchmarks44 hours ago

MEASURED

Verified 4 minutes ago · list prices, not negotiated rates.