The feature that solved a problem the users did not have
A product manager at a consumer fintech app built an AI feature the whole team was sure users wanted. The users had never asked for it, and once someone finally watched them, it was obvious why.
The feature that solved a problem the users did not have
A product manager at a consumer fintech app told me about a feature that was easy to approve and wrong from the start. The idea sounded obvious in the room. People do not understand their spending, so build an AI that categorizes every transaction and explains where the money goes. Everyone at the table nodded. They all wished they understood their own spending better. The feature shipped to a beta group with real enthusiasm behind it.
Almost nobody used it. The team assumed the categorization was off, so they improved it. Still almost nobody used it. The engagement charts were flat in a way that no amount of model tuning moved. It took a round of actual user conversations to see the thing they had missed from the beginning.
The assumption was about the team, not the users
When they finally sat with users, the picture was plain. The people in this app were not confused about where their money went. They already knew. They were paycheck to paycheck, tracking every dollar in their heads out of necessity, and an AI telling them they spent a lot on groceries was telling them something they lived every day. The feature answered a question these users had already answered for themselves. What they actually wanted was help with the thing they could not do on their own, which was smoothing the gap between a bill due on the fifth and a paycheck landing on the seventh.
The feature had been built from the team’s own experience. The people who designed it were salaried, a little disorganized about money, and genuinely helped by categorization. They assumed their users were the same kind of confused. They were not. The need was projected from the builders onto a user base that did not share it.
This is the trap with AI features specifically, because they are exciting to build. A model that categorizes and explains is fun to make and demos beautifully. That energy makes it easy to skip the boring question of whether the person on the other end has this problem at all. The feasibility of the feature said nothing about the need for it, and the team read one as the other.
A friend who leads product at an education company described the same mistake. Her team built an AI tutor that explained concepts in more detail, sure that students wanted deeper explanations. The students wanted the opposite. They were overwhelmed and wanted shorter, faster answers. The team had built for the student they imagined, a curious one with time, instead of the stressed one they actually had.
Watch a real user before you build
The correction is not complicated, and it is cheap compared to shipping the wrong thing. Before you commit to an AI feature, find real users, the actual ones, and watch them face the problem you think you are solving. Not a survey. Not the team’s shared intuition. A few real people doing the real task.
Questions worth answering with users, not with the team:
- Do these users actually have the problem, or do we have it and assume they share it?
- How do they handle this today, and does it already work well enough for them?
- If we solved this perfectly, would it change anything they care about?
- Which of their problems is the one they cannot solve on their own?
If the users do not recognize the problem when you describe it, that is the signal to stop, and it is far cheaper to hear it in a discovery conversation than in a flat engagement chart six months later.
How we approach it at Density Labs
Testing the assumed need against real users is a core move in the AI Opportunity Assessment, our fixed two-week engagement at $2,500. Before scoping any build, we get in front of the people who would use the feature and check that the problem is theirs and not only the team’s. Sometimes the most valuable thing we deliver is evidence that a well-loved idea solves a problem the users do not have, which saves a build that would have shipped to silence.
An AI feature that solves a problem your users do not have is not a small miss. Watch a real user before you write the spec, because the team’s confidence is not the same as the user’s need.