Healthcare AI Is Entering Its Accountability Era

By Rohit Mahajan

Co-Host, The Big Unlock Podcast

I’ll be in San Diego on October 22–23 for the HIMSS AI in Healthcare Forum. I’m looking forward to hearing from the leaders who are making AI work inside healthcare organizations, and to bringing those conversations to The Big Unlock audience.

The question I hope to explore is: What does it take to make AI dependable in everyday care and operations?

Healthcare has no shortage of promising pilots. The harder work begins when a tool must fit into a clinician’s day, draw on data that may be incomplete, and perform consistently across patients, teams, and sites. A successful demonstration can show what is possible. Sustained use tells us much more about whether the technology is useful.

That is why the forum’s focus on governance, data, implementation, and clinical and operational impact feels timely. These topics belong in the same conversation. A health system cannot evaluate an AI application solely on the strength of its model. Leaders also need to know who is accountable for its use, how its performance will be monitored, and what happens when the output is wrong or the workflow changes.

I’m particularly interested in three questions.

Where is AI making a measurable difference? I want to hear what organizations are seeing after deployment: whether patients get help sooner, clinicians spend less time on administrative work, or teams can deliver a service more reliably. The most useful stories include the measures, the tradeoffs, and what had to change to achieve the result.

How are health systems redesigning work around AI? Adding AI to an existing process may save a few steps, but the larger opportunity is to examine the process itself. Who receives the output? Who acts on it? When does a person need to step in? Those decisions determine whether a promising tool becomes part of a better way of working.

How are leaders earning trust at scale? Governance must be practical enough to guide decisions before and after deployment. I’m eager to learn how organizations are evaluating tools, defining clinical oversight, checking for uneven performance, and responding when a system falls short.

These are the kinds of questions we ask on The Big Unlock. The conversations that stay with me are often the ones in which leaders explain what they learned from implementation: where their assumptions were challenged, how they brought people along, and what they would do differently next time.

I look forward to continuing that conversation in San Diego. If you’re attending the forum and working through the realities of healthcare AI, I’d welcome the chance to connect. I’ll share the ideas and perspectives that stand out in the days following the event.

You can save 35% on registration with the code BIGUNLOCK at the HIMSS AI in Healthcare Forum registration page. See you there!