Understanding LLM Token Economics: Inputs, Outputs, and Context Windows

Every large language model API bills the same way: you pay per token, with separate meters for what you send (input) and what the model writes back (output). A token is a chunk of text roughly 4 characters long, so 1,000 tokens is about 750 English words. That system prompt you carefully engineered, the chat history you replay on every turn, the documents you stuff into context: all of it is metered input, billed on every single request.

Why output costs more than input

Output tokens are the expensive ones. Because a model must run a full forward pass to generate each new token, providers price output above input, and usually well above. Across the 42 models we price, output costs a median of 5 times input, reaching 8.3 times at the far end. The rule has real exceptions worth knowing about: 11 of them charge less than three times, and 4 charge the same rate in both directions, which changes the arithmetic entirely if your work writes more than it reads. This asymmetry means the shape of your workload matters as much as its size: a summarization pipeline that reads 10,000 tokens and writes 200 has a completely different cost profile than a content generator that reads 200 and writes 10,000.

The context window trap

Context windows have exploded from 4K to over a million tokens, and that creates a subtle budget hazard. A chat application that naively resends the full conversation history pays quadratically over the life of a session: turn 50 might carry 40,000 tokens of history as fresh input. Long context is a capability, not an obligation. Trimming history, summarizing older turns, and retrieving only relevant chunks routinely cuts input spend by half or more without hurting quality.

What to measure before you choose a model

The practical takeaway: measure your average input and output tokens per request before choosing a model, then multiply by realistic monthly volume. That is exactly what the cost calculator does, and the ranking often surprises teams who assumed the sticker price per million tokens told the whole story.