In a study of 48 medical students and physicians, researchers deliberately degraded an AI diagnostic system’s accuracy, only 12.5% noticed. When participants diagnosed first and then compared with the AI’s recommendations, their confidence in their diagnoses fell faster than their trust in the AI
npj Digital Medicine - Challenges for human oversight in detecting system malfunctions in AI-assisted medical diagnostics