inferenstack — the market read on AI inference · last observation 2026-09-20. See the boards
Price spread

Llama-3.1-70B-Instruct

meta· 2024-07-23· 131K ctx· llama3.1
open weightstool callstructured quant: unknown

spread (output)

2.5×

$0.400 – $0.990 · 9 providers

9 providers priced
ProviderInputOutputCache rdBlended
Nvidia
relay router
free/—free/——free/—
Kilo Gateway
relay router
$0.400$0.400—$0.400*
OpenRouter
unknown
$0.400$0.400—$0.400*
Vercel AI Gateway
unknown
$0.720$0.720—$0.720*
Amazon Bedrock
hyperscaler
$0.720$0.720—$0.720*
LLM Gateway
relay router
$0.720$0.720—$0.720*
Amazon Bedrock
hyperscaler
$0.720$0.720—$0.720*
DevPass (LLM Gateway)
relay router
$0.720$0.720—$0.720*
CoreWeaveoutlier
relay router
$0.800$0.800$0.800$0.800
Merge Gatewayoutlier
unknown
$0.990$0.990—$0.990*

Data: models.dev (MIT), snapshot 2026-09-20. Prices are vendor-published; verify before purchase. Methodology.