inferenstack — the market read on AI inference · last observation 2026-09-20. See the boards
Price spread

Llama-3.1-8B-Instruct

meta· 2024-07-23· 131K ctx· llama3.1
open weights quant: unknown

spread (output)

18×

$0.025 – $0.450 · 18 providers

18 providers priced
ProviderInputOutputCache rdBlended
Nvidia
relay router
free/—free/——free/—
Inference
relay router
$0.025$0.025—$0.025*
Helicone
relay router
$0.020$0.030—$0.021*
Kilo Gateway
relay router
$0.020$0.040—$0.022*
Abacus
relay router
$0.020$0.050—$0.023*
Helicone
relay router
$0.020$0.050—$0.023*
NovitaAI
relay router
$0.020$0.050—$0.023*
Hugging Face
relay router
$0.060$0.060—$0.060*
OpenRouter
unknown
$0.050$0.080$0.025$0.037
NanoGPT
relay router
$0.054$0.085$0.027$0.040
Cortecs
relay router
$0.167$0.167—$0.167*
Pioneer
relay router
$0.200$0.200$0.200$0.216
CoreWeave
relay router
$0.220$0.220$0.220$0.220
Amazon Bedrock
hyperscaler
$0.220$0.220—$0.220*
Amazon Bedrock
hyperscaler
$0.220$0.220—$0.220*
Merge Gateway
unknown
$0.220$0.220—$0.220*
Vercel AI Gateway
unknown
$0.220$0.220—$0.220*
Cloudflare Workers AIfp8
relay router
$0.152$0.287—$0.164*
Neon
relay router
$0.150$0.450—$0.177*

Data: models.dev (MIT), snapshot 2026-09-20. Prices are vendor-published; verify before purchase. Methodology.