Expert agreement on the presence and spatial localization of melanocytic features in dermoscopy Journal Article


Authors: Liopyris, K.; Navarrete-Dechent, C.; Marchetti, M. A.; Rotemberg, V.; Apalla, Z.; Argenziano, G.; Blum, A.; Braun, R. P.; Carrera, C.; Codella, N. C. F.; Combalia, M.; Dusza, S. W.; Gutman, D. A.; Helba, B.; Hofmann-Wellenhof, R.; Jaimes, N.; Kittler, H.; Kose, K.; Lallas, A.; Longo, C.; Malvehy, J.; Menzies, S.; Nelson, K. C.; Paoli, J.; Puig, S.; Rabinovitz, H. S.; Rishpon, A.; Russo, T.; Scope, A.; Soyer, H. P.; Stein, J. A.; Stolz, W.; Sgouros, D.; Stratigos, A. J.; Swanson, D. L.; Thomas, L.; Tschandl, P.; Zalaudek, I.; Weber, J.; Halpern, A. C.; Marghoob, A. A.
Article Title: Expert agreement on the presence and spatial localization of melanocytic features in dermoscopy
Abstract: Dermoscopy aids in melanoma detection; however, agreement on dermoscopic features, including those of high clinical relevance, remains poor. In this study, we attempted to evaluate agreement among experts on exemplar images not only for the presence of melanocytic-specific features but also for spatial localization. This was a cross-sectional, multicenter, observational study. Dermoscopy images exhibiting at least 1 of 31 melanocytic-specific features were submitted by 25 world experts as exemplars. Using a web-based platform that allows for image markup of specific contrast-defined regions (superpixels), 20 expert readers annotated 248 dermoscopic images in collections of 62 images. Each collection was reviewed by five independent readers. A total of 4,507 feature observations were performed. Good-to-excellent agreement was found for 14 of 31 features (45.2%), with eight achieving excellent agreement (Gwet's AC >0.75) and seven of them being melanoma-specific features. These features were peppering/granularity (0.91), shiny white streaks (0.89), typical pigment network (0.83), blotch irregular (0.82), negative network (0.81), irregular globules (0.78), dotted vessels (0.77), and blue–whitish veil (0.76). By utilizing an exemplar dataset, a good-to-excellent agreement was found for 14 features that have previously been shown useful in discriminating nevi from melanoma. All images are public (www.isic-archive.com) and can be used for education, scientific communication, and machine learning experiments. © 2023 The Authors
Keywords: melanoma; image analysis; nevus; melanocyte; epiluminescence microscopy; multicenter study; cross-sectional study; observational study; scar; machine learning; human; female; article
Journal Title: Journal of Investigative Dermatology
Volume: 144
Issue: 3
ISSN: 0022-202X
Publisher: Elsevier Science, Inc.  
Date Published: 2024-03-01
Start Page: 531
End Page: 539.e13
Language: English
DOI: 10.1016/j.jid.2023.01.045
PUBMED: 37689267
PROVIDER: scopus
PMCID: PMC11498320
DOI/URL:
Notes: Article -- MSK Cancer Center Support Grant (P30 CA008748) acknowledged in PDF -- MSK corresponding author is Ashfaq Marghoob -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Allan C Halpern
    398 Halpern
  2. Stephen Dusza
    291 Dusza
  3. Ashfaq A Marghoob
    537 Marghoob
  4. Kivanc Kose
    83 Kose
  5. Michael Armando Marchetti
    156 Marchetti
  6. Jochen Weber
    17 Weber