Checklist for evaluation of image-based artificial intelligence reports in dermatology: CLEAR Derm consensus guidelines from the International Skin Imaging Collaboration Artificial Intelligence Working Group Guidelines


Authors: Daneshjou, R.; Barata, C.; Betz-Stablein, B.; Celebi, M. E.; Codella, N.; Combalia, M.; Guitera, P.; Gutman, D.; Halpern, A.; Helba, B.; Kittler, H.; Kose, K.; Liopyris, K.; Malvehy, J.; Seog, H. S.; Soyer, H. P.; Tkaczyk, E. R.; Tschandl, P.; Rotemberg, V.
Title: Checklist for evaluation of image-based artificial intelligence reports in dermatology: CLEAR Derm consensus guidelines from the International Skin Imaging Collaboration Artificial Intelligence Working Group
Abstract: Importance: The use of artificial intelligence (AI) is accelerating in all aspects of medicine and has the potential to transform clinical care and dermatology workflows. However, to develop image-based algorithms for dermatology applications, comprehensive criteria establishing development and performance evaluation standards are required to ensure product fairness, reliability, and safety. Objective: To consolidate limited existing literature with expert opinion to guide developers and reviewers of dermatology AI. Evidence Review: In this consensus statement, the 19 members of the International Skin Imaging Collaboration AI working group volunteered to provide a consensus statement. A systematic PubMed search was performed of English-language articles published between December 1, 2008, and August 24, 2021, for "artificial intelligence"and "reporting guidelines,"as well as other pertinent studies identified by the expert panel. Factors that were viewed as critical to AI development and performance evaluation were included and underwent 2 rounds of electronic discussion to achieve consensus. Findings: A checklist of items was developed that outlines best practices of image-based AI development and assessment in dermatology. Conclusions and Relevance: Clinically effective AI needs to be fair, reliable, and safe; this checklist of best practices will help both developers and reviewers achieve this goal. © 2021 American Medical Association. All rights reserved.
Keywords: adult; skin; systematic review; artificial intelligence; medline; dermatology; human experiment; checklist; human; male; female; article; english (language)
Journal Title: JAMA Dermatology
Volume: 158
Issue: 1
ISSN: 2168-6068
Publisher: American Medical Association  
Date Published: 2022-01-01
Start Page: 90
End Page: 96
Language: English
DOI: 10.1001/jamadermatol.2021.4915
PUBMED: 34851366
PROVIDER: scopus
DOI/URL:
Notes: Review -- Export Date: 1 March 2022 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Allan C Halpern
    396 Halpern
  2. Kivanc Kose
    81 Kose