Multi-institutional assessment of pathologist scoring HER2 immunohistochemistry Journal Article


Authors: Robbins, C. J.; Fernandez, A. I.; Han, G.; Wong, S.; Harigopal, M.; Podoll, M.; Singh, K.; Ly, A.; Kuba, M. G.; Wen, H.; Sanders, M. A.; Brock, J.; Wei, S.; Fadare, O.; Hanley, K.; Jorns, J.; Snir, O. L.; Yoon, E.; Rabe, K.; Soong, T. R.; Reisenbichler, E. S.; Rimm, D. L.
Article Title: Multi-institutional assessment of pathologist scoring HER2 immunohistochemistry
Abstract: The HercepTest was approved 20+ years ago as the companion diagnostic test for trastuzumab in human epidermal growth factor 2 (HER2) or ERBB2 gene-amplified/overexpressing breast cancers. Subsequent HER2 immunohistochemistry (IHC) assays followed, including the now most common Ventana 4B5 assay. Although this IHC assay has become the clinical standard, its reliability, reproducibility, and accuracy have largely been approved and accepted on the basis of concordance among small numbers of pathologists without validation in a real-world setting. In this study, we evaluated the concordance and interrater reliability of scoring HER2 IHC in 170 breast cancer biopsies by 18 breast cancer-specialized pathologists from 15 institutions. We used the Observers Needed to Evaluate Subjective Tests method to determine the plateau of concordance and the minimum number of pathologists needed to estimate interrater agreement values for large numbers of raters, as seen in the real-world setting. We report substantial discordance within the intermediate categories (<1% agreement for 1+ and 3.6% agreement for 2+) in the 4-category HER2 IHC scoring system. The discordance within the IHC 0 cases is also substantial with an overall percent agreement (OPA) of only 25% and poor interrater reliability metrics (0.49 Fleiss' kappa, 0.55 intraclass correlation coefficient). This discordance can be partially reduced by using a 3-category system (28.8% vs 46.5% OPA for 4-category and 3-category scoring systems, respectively). Observers Needed to Evaluate Subjective Tests plots suggest that the OPA for the task of determining a HER2 IHC score 0 from not 0 plateaus statistically around 59.4% at 10 raters. Conversely, at the task of scoring HER2 IHC as 3+ or not 3+ pathologists' concordance was much higher with an OPA that plateaus at 87.1% with 6 raters. This suggests that legacy HER2 IHC remains valuable for finding the patients in whom the ERBB2 gene is amplified but unacceptably discordant in assigning HER2-low or HER2-negative status for the emerging HER2-low therapies. Copyright © 2022 United States & Canadian Academy of Pathology. Published by Elsevier Inc. All rights reserved.
Keywords: immunohistochemistry; genetics; reproducibility; reproducibility of results; metabolism; in situ hybridization, fluorescence; proto oncogene; epidermal growth factor receptor 2; pathology; breast neoplasms; tumor marker; fluorescence in situ hybridization; breast tumor; receptor, erbb-2; genes, erbb-2; pathologist; her2; prognostic markers; pathologists; humans; human; female; predictive markers; biomarkers, tumor
Journal Title: Modern Pathology
Volume: 36
Issue: 1
ISSN: 0893-3952
Publisher: Nature Research  
Date Published: 2023-01-01
Start Page: 100032
Language: English
DOI: 10.1016/j.modpat.2022.100032
PUBMED: 36788069
PROVIDER: scopus
PMCID: PMC10278086
DOI/URL:
Notes: Article -- MSK Cancer Center Support Grant (P30 CA008748) acknowledged in PubMed and PDF -- Export Date: 1 March 2023 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Hannah Yong Wen
    307 Wen
  2. Maria Gabriela Kuba
    30 Kuba