Posts

Input vs Output Token Pricing

Output tokens usually cost 3x to 5x more than input. See the real ratios for 28 models and how each one changes your monthly bill.
Onsp
Bar chart of the output to input price ratio for nine LLM APIs, from Grok 4.3 at 2x to GPT-5.2 at 8x

Every provider charges less for input than for output, and the size of that gap varies far more than most teams expect. Understanding why it exists, and how wide it is, changes which model you should pick for a given workload.

Why output costs more

Input tokens are processed in parallel. The whole prompt can be pushed through the model at once, which is efficient on modern accelerators. Output tokens are generated one at a time, each requiring a full forward pass, with the result appended and fed back in. Generating a thousand tokens takes a thousand sequential steps; reading a thousand tokens does not.

That asymmetry is the reason output pricing is higher, and it is also why output price is the number to optimise when your product generates long responses.

The multiple varies from 2x to 6x

ModelInputOutputMultiple
Grok 4.3$1.25$2.502.0x
Grok 4.6$2.00$6.003.0x
DeepSeek V4 Pro$1.32$3.963.0x
GPT-4.1$2.00$8.004.0x
DeepSeek V4.1 Flash$0.30$1.204.0x
GPT-6 Astra$10.00$50.005.0x
GPT-6.1 Sol$2.00$10.005.0x
GPT-6 Sol$2.00$10.005.0x
GPT-6 Luna$0.10$0.505.0x
GPT-5.6 Sol$4.00$20.005.0x
Claude Fable 5.1$10.00$50.005.0x
Claude Opus 5$5.00$25.005.0x
Claude Sonnet 5$2.00$10.005.0x
Claude Sonnet 4.6$3.00$15.005.0x
Claude Haiku 4.5$1.00$5.005.0x
Gemini 3.8 Flash$0.75$3.755.0x
Gemini 3.7 Flash$0.75$3.755.0x
GPT-5.6 Luna$0.20$1.206.0x
GPT-5.6 Terra$2.00$12.006.0x
GPT-5.5$5.00$30.006.0x
GPT-5.4$2.50$15.006.0x
GPT-5.4 mini$0.75$4.506.0x
Gemini 3.5 Flash$1.50$9.006.0x
Gemini 3.1 Pro (Preview)$2.00$12.006.0x
GPT-5.4 nano$0.20$1.256.3x
GPT-5.2$1.75$14.008.0x
Gemini 2.5 Pro$1.25$10.008.0x
Gemini 3.5 Flash-Lite$0.30$2.508.3x

The lowest multiple in this dataset is Grok 4.3 at 2.0x. The highest is Gemini 3.5 Flash-Lite at 8.3x. For a generation-heavy workload that difference matters more than the headline input rate.

Choosing a model from your ratio

Compute your own input-to-output ratio from production logs, then price candidates as (in_ratio × in_price + out_ratio × out_price) / (in_ratio + out_ratio).

Workload shapeTypical ratioWhat matters
Classification, extraction20:1 input-heavyInput price and cache rate
RAG question answering10:1 input-heavyInput price, cache rate, context window
Chat3:1 balancedBlended price
Code generation1:5 output-heavyOutput price and output multiple
Long-form writing1:10 output-heavyOutput price, max output cap

Practical levers on the output line

Set a max output token cap per endpoint. Unbounded generation is the single most common cause of an unexpected output bill, because a model that decides to elaborate will elaborate.

Instruct format explicitly. "Return only the JSON object, no explanation" removes the preamble that otherwise lands on the output line. Use structured output modes where offered, since constrained decoding can also reduce wasted tokens.

Watch reasoning overhead. On reasoning models, internal tokens are billed at the output rate even though you never see them. Lowering reasoning effort on straightforward tasks cuts the output line directly.

Where caching fits

Caching only applies to input. There is no mechanism to cache output, so a cache can never reduce the output portion of a bill. If output dominates your spend, caching will disappoint you, and the right move is model selection plus output caps instead.

Price your actual ratio in the calculator before choosing — a model that looks expensive per token can be the cheapest for your shape of traffic.

Related reading

Post a Comment

Cookie Consent
We serve cookies on this site to analyze traffic, remember your preferences, and optimize your experience.
Oops!
It seems there is something wrong with your internet connection. Please connect to the internet and start browsing again.
AdBlock Detected!
We have detected that you are using adblocking plugin in your browser.
The revenue we earn by the advertisements is used to manage this website, we request you to whitelist our website in your adblocking plugin.
Site is Blocked
Sorry! This site is not available in your country.