Do machines actually beat doctors? ROC curves and performance metrics

Deep learning research in medicine is a bit like the Wild West at the moment; sometimes you find gold, sometimes a giant steampunk spider-bot causes a ruckus. This has derailed my series on whether AI will be replacing doctors soon, as I have felt the need to focus a bit more on how to assess … Continue reading Do machines actually beat doctors? ROC curves and performance metrics

Quick thoughts on ChestXray14, performance claims, and clinical tasks.

So, the big news in medical AI research is that the Stanford ML group under Andrew Ng has released a paper on chest x-ray interpretation that claims human performance at identifying pneumonia. First up, very cool! Second up, I have concerns. Vague and not so vague discomforts. So, after having a few days to wrap … Continue reading Quick thoughts on ChestXray14, performance claims, and clinical tasks.