Model selection and cost: cheaper isn’t always worse

The default move when a team adds AI is to reach for the largest, newest, most expensive model available and assume quality follows price. Sometimes it does. Often it does not, and the team pays a premium for capability the feature never uses. Model selection is a cost decision as much as a quality one, and the two are not opposites.

The cost geometry hiding in your prompts

Before choosing a model, it helps to know where the money goes inside one. On a model like Claude Sonnet, output tokens cost roughly five times what input tokens cost. That single ratio should shape your choices. A feature that reads a long document and returns a one-line verdict has a very different cost profile from one that reads a short prompt and writes three paragraphs. The expensive model that writes concisely can cost less than the cheap model that rambles. Price per token is only half the equation. What the model is asked to produce is the other half, and it is the half most teams ignore when they compare models.

Match the model to the problem, then upgrade

A founder building an AI personal-branding tool learned the cost and quality question from the output side. Early generated content “sound robotic,” so bad that “anyone with sense of writing could identify it was written by AI.” His fix was not a bigger model. It was building a context layer, user-defined personas that gave the model something specific to work from. Only after that layer existed did upgrading the underlying model pay off. Rolling in newer, cheaper-to-run models on top of good context made the output, in his words, “just remarkable.” The order mattered. A frontier model on top of no context is expensive and still robotic. A modest model on top of good context is cheap and convincing.

Sometimes the right model is not a language model at all

The most disciplined model decision I have heard came from a founder building an enterprise collaboration product, who resisted the industry’s default entirely. “We are not a large language model,” he said. His product runs “our own proprietary AI that applies to the telemetry of your phone and laptop and calendar availability.” Large language models were a possible future for one narrow feature, not the engine of the product. He picked the model that fit the signal he actually had, a small model on structured telemetry, instead of paying frontier prices to answer a question that never needed one.

That is the point cheaper-isn’t-worse is really making. The question is not “which model is best.” It is “which model is enough for this specific job,” because the gap between enough and best is money you spend every single request.

How to choose without overpaying

A model selection that respects cost tends to check the same things:

Output shape. Long generations are expensive. Favor models and prompts that produce what the task needs and no more.
Context first. Fix the context and retrieval before reaching for a bigger model, because most quality gaps live there.
Fit over frontier. Pick the smallest model that clears the quality bar for this task, not the most capable one on the leaderboard.
Room to swap. Build so you can change models later, because a cheaper one that is good enough will keep arriving.

How we approach it at Density Labs

Our AI Readiness Assessment is a fixed two week engagement, priced at $2,500. When model choice is the question, we start from the job, not the leaderboard. We look at what the feature has to produce, how long its outputs run, and whether the problem even needs a language model, then match a model to that reality. The common result is a smaller, cheaper model doing the work just as well, because the quality gap was never in the model.

The most expensive model is not a strategy. Fit is.