Models/Meta/Llama 3.1 8B Instruct

Llama 3.1 8B Instruct

Meta · Open weights · Released Jul 23, 2024 · meta-llama/llama-3.1-8b-instruct
Best $0.02 in / $0.04 out via DeepInfra · fp8
CompareEstimate cost
131K contextToolsStructured outputPrompt cachingOpen weights
Available from 4 providersUSD / MTOK · PRICES 16 MINUTES AGO · SPEED 4 DAYS AGO
EST. MONTHLY COSTclick a row for detail · click headers to sort
PROVIDERINPUTOUTPUTCACHECONTEXTQUANTTTFTTPSSMOKEUPTIME
TTFT/TPS: median (P50) over trailing 504h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · SMOKE: of 5 programmatic capability probes passed (JSON schema, instruction following, tool call, long-context, benign compliance; retry-once) · screened via OpenRouter routing · v0.2 · methodology v1.1 · measured 4 days ago
SERVE THIS MODEL AND NOT LISTED? LIST YOUR INFERENCE →
Recent changesRSS ↗
Nov 20, 2026endpoint added · amazon-bedrock4 → 4
Nov 20, 2026endpoint removed · cloudflare4 → 4
Nov 4, 2026endpoint removed · novita5 → 4
About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Specifications
Context window131,072
Max output16,384
Modalities intext
Modalities outtext
LicenseOpen weights
ReleasedJul 23, 2024
Knowledge cutoff2023-12-31
TokenizerLlama3
Open weightsGATED
Downloads4.1M
Likes9.1K
Licensellama3.1
safetensorspytorch
Embed badge
Llama 3.1 8B Instruct price and speed badge
[![Llama 3.1 8B Instruct](https://modelindex.ai/badge/meta-llama/llama-3.1-8b-instruct)](https://modelindex.ai/models/meta-llama/llama-3.1-8b-instruct)
Sources
OpenRouter API16 minutes ago
AGGREGATOR
Hugging Face16 minutes ago
COMMUNITY
ModelIndex benchmarks19 days ago
MEASURED
Verified 16 minutes ago · list prices, not negotiated rates.