Pairing with an agent that never says it does not know
A human pair would have said they were unsure. The agent answered every question with the same confidence, whether it knew or was guessing.
Pairing with an agent that never says it does not know
A staff engineer at a fintech company described what it was like to pair with an agent all day, and what he missed from pairing with a person. When he paired with a human, there was a constant background signal he had come to rely on without noticing. His partner would say they were not sure, or they would hesitate, or their tone would shift when they moved from something they knew to something they were guessing at. That signal told him when to trust and when to check. The agent had no such signal. It answered every question, correct or not, known or guessed, in exactly the same confident register. He had lost the uncertainty cue that a human pair provides for free, and it took him a while to realize how much he had leaned on it.
Human pairs broadcast their confidence, agents do not
When two people work together on code, they exchange far more than the code. They exchange confidence levels. A good pair signals, through words and tone and hesitation, how sure they are about each thing they say. This is when they are certain. This is when they are guessing. This is when you should double-check them. That signal is one of the most valuable things about pairing, because it tells you where to spend your scrutiny, and it comes so naturally between people that you stop noticing it is there.
An agent does not broadcast confidence. It presents everything, the things it knows well and the things it is fabricating, in the same fluent, assured voice. There is no hesitation before a guess, no shift in register when it moves from solid ground to invented ground. The uncertainty signal that a human pair provides continuously is simply absent, and that absence is easy to miss, because the agent’s confident tone reads, to a brain trained on human pairs, like a human’s confident tone, which usually means the human is sure. So you extend the trust you would extend to a confident human, and the agent’s confidence was never evidence of anything, because it is confident about everything equally. The signal you are reading is not there. You are hallucinating it from the fluency.
This is a genuinely new hazard in pairing. With a person, you could partly outsource the question of when to check by listening for their uncertainty. With an agent, that outsourcing fails, because there is no uncertainty to hear, and if you rely on the old signal you will trust the guesses exactly as much as the knowledge.
Supply the skepticism the agent will not
The lesson is that when you pair with an agent, you have to provide the uncertainty signal yourself, because the agent will not give it to you. Its confidence carries no information, so your decision about when to check has to come from you, not from its tone.
How engineers pair well with an agent that never hedges.
- Treat the agent’s confidence as constant and meaningless, and base your scrutiny on the stakes and the claim, not on how sure it sounds.
- Verify anything you would have double-checked with a hesitant human, since the agent will state a guess as firmly as a fact.
- Ask the agent to show its work or its sources, so you can check the reasoning the confident tone is hiding.
- Watch for the places agents most often guess, unfamiliar APIs, edge cases, recent changes, and check those harder.
- Keep your own judgment in the loop, because you are now the only source of the uncertainty signal that used to be shared.
The agent is a capable pair in many ways. It just does not tell you when to distrust it, and with a human that was half the value of the partnership.
How we think about it at Density Labs
The missing uncertainty signal is one of the subtlest things that changes when engineers move from pairing with people to pairing with agents. A human partner tells you, constantly and for free, how much to trust them. An agent tells you nothing, because it is confident about everything, and an engineer who is used to reading a partner’s confidence will misread the agent’s, which is not a signal at all.
When we help teams build good habits around AI-assisted work, this is one of the things we name explicitly, because it is invisible until someone points it out. The skepticism that a human pair partly supplied now has to come entirely from the engineer, and that only happens if they know the agent’s confidence is worthless as a guide.
A good human pair tells you when they are unsure. An agent never will, so you have to be the one who knows when to check.