ACCOUNTABILITY FOR AI IN HEALTHCARE OPERATIONS · POST 02

The Trust Problem Nobody Planned For

Don Wickelgren
Don Wickelgren
Founder, Xillium
Published May 19, 2026. Also shared on LinkedIn.
View the post on LinkedIn

AI adoption in healthcare admin stalls most often not because the tool failed — but because no one agreed on when to trust it.

We've seen this before. We've worked with organizations across value-based care transitions where execution was the problem — not strategy, not intent. The operational layer between policy and day-to-day action broke down, and the model got blamed for it.

AI implementation is running into the same wall.

Deloitte's TrustID data found that frontline worker trust in company-provided AI fell 31% in a two-month window in 2025. Trust in agentic AI — systems that act rather than just recommend — dropped 89% in the same window.

The reason is telling.

Recent clinical research found override rates above 73% for opaque AI recommendations. Transparent systems saw rates drop by more than half. The technology wasn't the variable. Clarity was.

There's a moment in every implementation where a person has to decide: go with what the system says, or override it. Most organizations haven't defined what that decision is supposed to look like. So individuals make it differently every time. Variance accumulates. Confidence erodes. The tool gets blamed.

That's exactly how value-based care failed in the organizations we worked with. The model was sound. Inconsistent execution destroyed it.

The technology question got answered. The operational question didn't.

Suggested citation
Wickelgren, Don. “The Trust Problem Nobody Planned For.” Accountability for AI in Healthcare Operations, Xillium Enterprise Solutions, Post 02, May 19, 2026.
https://www.xillium.com/series/the-trust-problem-nobody-planned-for

Xillium staffs the accountability layer these entries describe. What that looks like in practice is on our Solutions page.

Previous: The Gap Between Demo and RealityAll entriesNext: Exceptions Aren’t Edge Cases