Xillium Series

Accountability for AI in Healthcare Operations

A series by Don Wickelgren examining how accountability, workflow design, and human judgment shape AI in healthcare operations.

Published here as Xillium’s permanent, citable archive. Also shared on LinkedIn.

Don Wickelgren

By Don Wickelgren · Founder, Xillium

View Don’s LinkedIn profile

The archive

Series entries

Sort by:
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
22
The System Cannot See What Never Enters It

The coverage gap created when relevant patient information arrives through channels an AI-supported workflow cannot see.

Read entry →
21
Oversight Is Set at Deployment, Not Authorization

The operational gap between human oversight written into an AI-enabled device’s authorization and the staffing, caseload, and escalation authority that determine whether oversight exists in practice.

Read entry →
20
The Output Is Not the Execution

The operational gap between AI-generated output and the reviewed, documented action a healthcare organization can stand behind.

Read entry →
19
Knowing Your Error Rate Is Not Knowing Where Your Errors Are

The difficulty of finding repeated AI errors when faster turnaround and clean random samples make a workflow appear healthy.

Read entry →
18
A Confidence Score Does Not Move the Obligation

The compliance and audit questions that remain when healthcare operations rely on vendor confidence scores that may change without notice.

Read entry →
17
We Were Watching the Wrong Signal

An account failure that remained hidden while activity, productivity, communication, and escalation reports continued to appear healthy.

Read entry →
16
Absence of Complaints Is Not Evidence It Worked

The difficulty of evaluating AI-supported administrative work when failures produce no complaint, contradiction, or downstream signal.

Read entry →
15
The Audit You’re Not Ready For

Two internal audit cases centered on a difficult question: who actually took the recorded action?

Read entry →
14
When AI Gets It Wrong in Healthcare, Who’s Responsible?

The unresolved responsibility questions surrounding AI-generated healthcare work when review and approval roles are not clearly assigned.

Read entry →
13
You Can’t Automate Judgment Out of Healthcare

The judgment calls hidden inside routine healthcare work when rules and payer criteria no longer provide a clear answer.

Read entry →
12
AI Didn’t Fail. The Handoff Did.

A referral failure that exposes what can happen when ownership is unclear at a workflow handoff.

Read entry →
11
The Ford Story: Everyone’s Drawing the Wrong Conclusion

A closer look at what changed inside Ford when AI use expanded and experienced engineers returned.

Read entry →
10
The Workflow Nobody Mapped

The gap between documented processes and the work teams actually perform through exceptions, workarounds, and unwritten knowledge.

Read entry →
9
What Prior Auth Actually Costs You

A look at the visible workload and less obvious operational costs created when prior authorizations are delayed, denied, or never completed.

Read entry →
8
The Pilot Looked Great. Then It Went Live.

What happens when a successful healthcare AI pilot encounters real-world volume, ambiguity, and exceptions.

Read entry →
7
Nurses Are Already Asking the Right Question

Frontline concerns about AI-supported clinical systems that may not recognize when their inputs or outputs are wrong.

Read entry →
6
The Horse Problem

Questions about the role and value of human judgment as healthcare organizations redesign workflows around AI.

Read entry →
5
Accountability Doesn’t Disappear With Automation

The accountability questions that remain when an AI system performs as designed but its output does not match operational reality.

Read entry →
4
Healthcare AI’s Real Design Problem

The operational questions that emerge when healthcare organizations have not clearly defined where AI tasks end and human judgment begins.

Read entry →
3
Exceptions Aren’t Edge Cases

An examination of the exception-heavy administrative work that healthcare automation pilots often fail to capture.

Read entry →
2
The Trust Problem Nobody Planned For

The uncertainty frontline teams face when organizations have not defined when AI output should be trusted, questioned, or overridden.

Read entry →
1
The Gap Between Demo and Reality

The operational gap that appears when promising healthcare AI demonstrations encounter real-world workflows, scale, and exceptions.

Read entry →