Foundations of AI in Healthcare · Related to Chapter 3

Neither Miracle Nor Threat: How to Judge a Medical AI by What It Actually Does

Neither Miracle Nor Threat: How to Judge a Medical AI by What It Actually Does

By André Leite and Vinícius Lain, authors of AI in Healthcare.

Every new technology in healthcare arrives wrapped in two opposite and equally exaggerated stories. On one side are the people promising it will "revolutionize" everything, clear the waiting lists, predict disease, end medical error. On the other are those who see risk in every line of code, a black box in every algorithm, a threat in every new acronym. Neither story helps the physician who has to decide, in practice, whether to trust a specific tool for a specific patient.

There is a more useful path, and it runs well away from both enthusiasm and fear: judge artificial intelligence by what it can functionally do. Don't ask "is this AI good?" in the abstract. Ask "for this exact task, with this exact data, validated in which population, with what error rate, and what happens when it gets it wrong?" It is the same standard we apply, or should apply, to any new test, drug or device before it enters clinical practice.

It also helps to understand that "artificial intelligence" is not one thing. A machine learning system trained under close supervision, like a resident learning from an experienced attending who corrects every step, is structurally different from a deep learning model that learns by exposure to millions of examples. The second works in a more opaque way and, in many cases, performs better, but it also tells you less about the "why" behind each decision. Confusing the two is like treating an intern and a senior specialist the same way just because both wear a white coat.

Healthy skepticism is not resistance to change. It is scientific rigor applied to a new technology, exactly what we expect for any advance in medicine. And unchecked enthusiasm is not innovation either. At best it is naivety, and at worst it is negligence.

The right question was never "will AI replace the doctor?" It is "does this specific tool improve my patient's outcome, on what evidence, and under what supervision?" Whoever answers that question rigorously is closer to using artificial intelligence well than someone who just cheers for it or against it.

André Leite Vinícius Lain
André Leite and Vinícius Lain, authors of AI in Healthcare.
André Leite · Vinícius Lain

Discover the book

Keep reading

Explore by theme · Explore by chapter · All articles