Models/Microsoft/WizardLM-2 8x22B

WizardLM-2 8x22B

Name: WizardLM-2 8x22B API access
Brand: Microsoft

Microsoft · Open weights · Released Apr 16, 2024 · microsoft/wizardlm-2-8x22b

Compare Estimate cost

66K contextStructured outputOpen weights

Available from 1 providerUSD / MTOK · VERIFIED 4 MINUTES AGO

EST. MONTHLY COSTclick a row for detail · click headers to sort

PROVIDER	INPUT	OUTPUT	CACHE	CONTEXT	QUANT	TTFT	TPS	UPTIME
Novita	$0.62	$0.62	—	66K	bf16	1.2s	12 tok/s	100.0%

TTFT/TPS: median (P50) over trailing 72h · chat10k profile (~10K in / 200 out) · measured via OpenRouter routing · methodology v1.1 · measured 44 hours ago

About

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

Specifications

Context window65,535

Max output8,000

Modalities intext

Modalities outtext

LicenseOpen weights

ReleasedApr 16, 2024

Knowledge cutoff2024-04-30

TokenizerMistral

WeightsHugging Face ↗

Phi 4$0.07 / $0.14

Embed badge

[![WizardLM-2 8x22B](https://modelindex.ai/badge/microsoft/wizardlm-2-8x22b)](https://modelindex.ai/models/microsoft/wizardlm-2-8x22b)

Sources

OpenRouter API4 minutes ago

AGGREGATOR

ModelIndex benchmarks44 hours ago

MEASURED

Verified 4 minutes ago · list prices, not negotiated rates.