Measuring What Matters: When the "What" Is Trust

We measure everything our AI does. We rarely measure whether anyone trusts it. A researcher's look at why that gap exists, and what it would take to close it.

Image created with AI tools

I want to start with something I noticed, not something I believe.

In rooms with executives, I have watched the same thing happen more than once. These are people who measure with real discipline. They can tell you their cost per transaction, their productivity per team, their adoption curve, their uptime to the decimal. Measurement is not foreign to them. It is the native language of how they run things.

Then I ask one question. How do you measure whether your organization actually trusts its AI?

And the room goes quiet.

Not a guilty quiet. Not an accusation landing. Just a pause, the particular silence of a question that has never been asked in that form before. Someone will eventually offer that they run model accuracy reports, or that they have a governance committee, or that there is an audit somewhere. All true. None of it an answer to the question I asked. The question was about trust, and there was no number to reach for.

I am not going to pretend that silence proves anything. One observation is not a finding. But it made me curious, and curiosity is a better place to begin than conviction.

The thing that made me curious

Here is what puzzled me about that silence.

We spend enormous effort measuring what our AI systems do. Their accuracy, their latency, their throughput, their cost. Whole dashboards exist for it. But we spend almost nothing measuring the thing that actually determines whether any of that effort matters: the confidence with which human beings decide to rely on the system. Whether they lean on it, or quietly work around it. Whether they trust it.

That struck me as odd. Because trust is not a soft afterthought in these systems. It is the hinge everything turns on. A model can be brilliant and go unused because no one believes it. A model can be mediocre and be over-trusted into a disaster. The performance of the model and the trust placed in it are two different quantities, and only one of them shows up on the dashboard.

So the question I could not put down was simply: why? Why do we measure the machine so carefully and the reliance on it not at all? Not because anyone decided trust was unimportant. Everyone says the opposite. So why the gap between what we say matters and what we actually measure?

A lens, from an unlikely place

I found a useful way to think about that gap in a book most people read for other reasons.

John Doerr popularized a deceptively simple idea in Measure What Matters. On the surface it is a book about OKRs, about goals and key results. But the deeper idea underneath the framework is this: OKRs were never really about metrics. They were a mechanism for making invisible priorities visible. The act of measuring something is the act of declaring, publicly and to yourself, that it matters. And the reverse is quietly true as well. What you never measure, you have treated as if it does not matter, whatever you say about it in your principles.

That reframed my question with some force. If trust is what decides whether an AI system gets adopted, questioned, overridden, or abandoned, then by any reasonable account it matters as much as anything on the dashboard. So why is it still handled as an intuition, a feeling in the room, rather than as something observable? Not because it is unimportant. Perhaps because we have not known how to see it.

Trust behaves like a latent variable

Here is the shift that, for me, changed the whole problem. And it is a small shift in language that turns out to be a large shift in method.

The instinct is to say trust should be measurable and go looking for the meter. But that is the wrong sentence. The right one is this: trust behaves like a latent variable.

That phrase comes from the sciences that have spent the longest wrestling with exactly this difficulty, the difficulty of studying something real that you cannot observe directly. And once you say it that way, the problem stops being strange and becomes familiar, because it is a problem those fields solved long ago.

Think about what we already measure this way, without blinking. Intelligence is never observed directly; it is inferred from performance across many tasks. Depression is never observed directly; it is inferred from a pattern of signs. The same is true of economic confidence, of quality of life, of customer satisfaction. Not one of these is read off an instrument. Every one of them is real, consequential, and studied rigorously. And every one of them is inferred from things you can see, rather than measured head-on.

Trust belongs in that family. You will never point a sensor at trust and get a reading. But that has never been how latent things are measured. They are measured through their traces.

What would trust leave behind?

So I stopped asking how to measure trust, and started asking the question a researcher would ask instead: if trust cannot be seen directly, what visible evidence would it leave behind?

This is the move that turns a slogan into science. You do not measure the hidden thing. You ask what the hidden thing causes, and you measure that.

So suppose trust in an AI system rises. What should we expect to see? People should override the system less often when it is right, and appropriately when it is wrong. Escalations should shift in character. The rate at which recommendations are accepted should change. The time spent re-verifying the system’s output should fall. Appeals, interventions, audit exceptions, all of these should move in patterns consistent with a change in reliance. And if trust falls, the same signals should move the other way.

Notice what has happened. Without ever claiming to measure trust directly, I now have a list of things I can observe: override rate, escalation frequency, recommendation acceptance, time to verification, human intervention, appeal rate, audit exceptions. These are not trust. They are the behavioral exhaust of trust, the visible residue a hidden quantity leaves in the operational record. And measuring the consequences of a latent variable is precisely how latent variables have always been studied.

I want to be careful here, because this is where rigor matters and where it is easy to overreach. Any single one of these signals can move for reasons that have nothing to do with trust. That is exactly why you do not lean on any single one. You look at the pattern across many, the way a diagnostician reads a panel of markers rather than a single number, and you reason from the pattern to the hidden state underneath. The mathematics for doing this well, for inferring a hidden quantity from noisy signals and for tracking how it moves over time, is mature and unglamorous and mostly borrowed from fields that have done it for decades. It does not need to be on the surface of this essay. It only needs to exist, and it does.

One more thing about trust: it does not hold still

There is a wrinkle that makes this harder than the classic textbook version, and it is worth naming because it changes what “measuring” even means.

Intelligence, once measured in an adult, is fairly stable. Trust is not. Trust in an AI system moves, and it moves because the world the system operates in moves. The data shifts. The users adapt. The conditions the system was validated under quietly stop holding. So trust is not only a hidden quantity; it is a hidden quantity in motion.

And that has a consequence I find genuinely important. If trust moves, then measuring it once tells you almost nothing about where it will be next quarter. A single reading is a photograph of a moving thing. The same measured value can mean opposite realities depending on the direction it arrived from: a system whose trust is recovering and one whose trust is collapsing can pass through the identical number on the way to very different fates. Only a sequence of readings, a trajectory, can tell them apart. Which suggests that if trust is worth measuring at all, it is worth measuring continuously, not certified once and filed away.

Why this matters to the person accountable

Let me connect this back to the executive in the quiet room, because this is not an academic puzzle for them. It is a future liability.

When an AI system fails, and eventually one will, the questions that arrive are all retrospective. Was this system trustworthy? Were you watching? What state was it in, and when did you know? These are questions about a quantity over time. And they can only be answered if that quantity was being observed as it moved, because a trajectory cannot be reconstructed after the fact. You cannot go back and take a measurement you never took. The evidence either exists because someone was collecting it all along, or it does not exist at all.

That reframes the quiet in the room. The silence was not a small gap in reporting. It was the absence of the one record that, on the hardest day, everyone will reach for and no one will find.

Where this is taking me

I will be honest that this line of thinking is a question I am still inside of, not a conclusion I am handing over. But it has led me somewhere specific, and I will name the direction even though I am not claiming the destination.

The question I keep returning to is whether executive trust in AI can be treated as a measurable construct, operationalized not through surveys and self-report alone, but through the behavioral, operational, governance, and outcome signals that a system generates as it runs, tracked over time as they evolve. Not to reduce trust to a single tidy number, but to make a hidden and consequential thing visible enough to reason about, argue over, and act on before a failure rather than after.

I do not think the next real advance in AI governance will come from larger models. I think it may come from better measurement. Not measurement of what the machine can do, we are already good at that, but measurement of the thing we keep saying matters most and keep leaving off the dashboard.

So I will end where a researcher should end, with the question rather than the answer.

If trust is what matters most, what evidence should organizations be collecting, starting now, to know whether they actually have it?

I do not think we have a good answer yet. I think it is the right question. And I would rather leave you holding a better question than a borrowed conviction.

Until next Tuesday….



Suneeta Modekurty
Founder & CEO | SANJEEVANI AI