Human-computer collaboration for skin cancer recognition Research Letter


Authors: Tschandl, P.; Rinner, C.; Apalla, Z.; Argenziano, G.; Codella, N.; Halpern, A.; Janda, M.; Lallas, A.; Longo, C.; Malvehy, J.; Paoli, J.; Puig, S.; Rosendahl, C.; Soyer, H. P.; Zalaudek, I.; Kittler, H.
Title: Human-computer collaboration for skin cancer recognition
Abstract: The rapid increase in telemedicine coupled with recent advances in diagnostic artificial intelligence (AI) create the imperative to consider the opportunities and risks of inserting AI-based support into new paradigms of care. Here we build on recent achievements in the accuracy of image-based AI for skin cancer diagnosis to address the effects of varied representations of AI-based support across different levels of clinical expertise and multiple clinical workflows. We find that good quality AI-based support of clinical decision-making improves diagnostic accuracy over that of either AI or physicians alone, and that the least experienced clinicians gain the most from AI-based support. We further find that AI-based multiclass probabilities outperformed content-based image retrieval (CBIR) representations of AI in the mobile technology environment, and AI-based support had utility in simulations of second opinions and of telemedicine triage. In addition to demonstrating the potential benefits associated with good quality AI in the hands of non-expert clinicians, we find that faulty AI can mislead the entire spectrum of clinicians, including experts. Lastly, we show that insights derived from AI class-activation maps can inform improvements in human diagnosis. Together, our approach and findings offer a framework for future studies across the spectrum of image-based diagnostics to improve human–computer collaboration in clinical practice. © 2020, The Author(s), under exclusive licence to Springer Nature America, Inc.
Keywords: adult; major clinical study; cancer diagnosis; diagnostic accuracy; clinical practice; prevalence; skin cancer; prediction; high risk patient; patient care; artificial intelligence; clinical decision making; telemedicine; human computer interaction; workflow; image retrieval; human; male; female; priority journal; article; clinical decision support system
Journal Title: Nature Medicine
Volume: 26
Issue: 8
ISSN: 1078-8956
Publisher: Nature Publishing Group  
Date Published: 2020-08-01
Start Page: 1229
End Page: 1234
Language: English
DOI: 10.1038/s41591-020-0942-0
PUBMED: 32572267
PROVIDER: scopus
DOI/URL:
Notes: Article -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Allan C Halpern
    396 Halpern