Logs an auditor can trust are logs no one can quietly edit
The team had a full record of every AI action. The auditor's first question was whether anyone could have changed it after the fact, and the honest answer was yes.
Logs an auditor can trust are logs no one can quietly edit
A security lead at a company going through its first serious audit told me about a question that landed harder than expected. The team had done the work most teams skip. They kept a full, detailed record of what the AI feature decided and did, per case, with the reasoning behind it. They were proud of it, and rightly so. Then the auditor asked a simple question. Could anyone have edited these records after they were written. The team thought about it and had to say yes. An engineer with database access could change an entry, and nothing would show that it had been changed. The record was complete, and its trustworthiness rested entirely on the assumption that nobody had altered it.
A log is evidence, and evidence is only as good as your confidence that it has not been tampered with. A complete record that anyone with access could quietly edit is not proof of what happened. It is a story that happens to match what happened, which an auditor, a regulator, or a court will treat very differently. The gap between “we recorded it” and “we can prove the record was not changed” is the gap between having logs and having logs someone else will trust.
A record you can edit is a record you cannot prove
The value of an audit trail in a dispute is that it establishes what actually occurred. That value depends on tamper resistance. If the record can be altered after the fact without leaving a trace, then its contents prove nothing on their own, because they are consistent both with the truth and with a convenient edit. The moment an outside party has a reason to doubt you, an editable log stops being evidence and becomes an assertion.
This matters most in exactly the situations where the trail is supposed to help. An investigation into a decision that harmed someone. A regulator checking whether you did what you claim. A legal dispute over an action the AI took. In each, the other side is not obligated to take your records at face value, and the first thing they will probe is whether those records could have been changed. If the answer is that they could, your careful logging carries much less weight than you thought.
The reason this gets overlooked is that internally, everyone trusts the logs. The team wrote them, the team believes them, and for day-to-day debugging that trust is fine. Audit is the context where internal trust is not the currency, and there the editability of the record is the whole question.
Make the trail tamper-evident
The fix is to store the audit trail so that alterations are prevented or, at minimum, detectable and attributable.
What that involves:
- Append-only storage. Write decision records to a store that does not allow edits or deletions in normal operation, so the history only grows.
- Tamper-evidence. Use integrity mechanisms that make any alteration detectable, so a changed record cannot pass as an original.
- Restrict and log access. Tightly limit who can reach the audit store at all, and record every access, so even reads are accountable.
- Separate it from the operational data. Keep the trail in a store distinct from the systems it records, so the same access that runs the feature cannot silently rewrite its history.
The teams that get this right build the trail to be believed by someone who has no reason to trust them. That is a higher bar than internal debugging, and it is the bar that matters when the record is finally tested. A tamper-evident log is the difference between offering evidence and offering your word.
How we approach it at Density Labs
In the AI Opportunity Assessment, our fixed two-week, $2,500 engagement, we look at whether the audit trail could be altered after the fact and whether such a change would be detectable. A complete but editable record is common, and it is exactly the weakness an auditor probes first. Making the trail tamper-evident is a design decision worth far more than the effort it takes, because it is what turns your logs into something an outside party will accept.
A record anyone can quietly edit proves nothing to the people who matter most. Make the audit trail tamper-evident, so what you recorded is what an auditor will believe.