Assessing endoscopic response in locally advanced rectal cancer treated with total neoadjuvant therapy: Development and validation of a highly accurate convolutional neural network Journal Article
| Authors: | Williams, H.; Thompson, H. M.; Lee, C.; Rangnekar, A.; Gomez, J. T.; Widmar, M.; Wei, I. H.; Pappou, E. P.; Nash, G. M.; Weiser, M. R.; Paty, P. B.; Smith, J. J.; Veeraraghavan, H.; Garcia-Aguilar, J. |
| Article Title: | Assessing endoscopic response in locally advanced rectal cancer treated with total neoadjuvant therapy: Development and validation of a highly accurate convolutional neural network |
| Abstract: | Background: Rectal tumors display varying degrees of response to total neoadjuvant therapy (TNT). We evaluated the performance of a convolutional neural network (CNN) in interpreting endoscopic images of either a non-complete response to TNT or local regrowth during watch-and-wait surveillance. Methods: Endoscopic images from stage II/III rectal cancers treated with TNT from 2012 to 2020 at a single institution were retrospectively reviewed. Images were labelled as Tumor or No Tumor based on endoscopy timing (before, during, or after treatment) and the tumor’s endoluminal response. A CNN was trained using ResNet-50 architecture. The area under the curve (AUC) was analyzed during training and for two test sets. The main test set included images of tumors treated with TNT. The other contained images of local regrowth. The model’s performance was compared to sixteen surgeons and surgical trainees who evaluated 119 images for evidence of tumor. Fleiss’ kappa was calculated by respondent experience level. Results: A total of 2717 images from 288 patients were included; 1407 (51.8%) contained tumor. The AUC was 0.99, 0.98, and 0.92 for training, main test, and local regrowth test sets. The model performed on par with surgeons of all experience levels for the main test set. Interobserver agreement was good (k = 0.71–0.81). All groups outperformed the model in identifying tumor from images of local regrowth. Interobserver agreement was fair to moderate (k= 0.24–0.52). Conclusions: A highly accurate CNN matched the performance of colorectal surgeons in identifying a noncomplete response to TNT. However, the model demonstrated suboptimal accuracy when analyzing images of local regrowth. © Society of Surgical Oncology 2024. |
| Keywords: | adult; controlled study; human tissue; aged; middle aged; retrospective studies; major clinical study; histopathology; advanced cancer; area under the curve; neoadjuvant therapy; cancer staging; follow up; follow-up studies; antineoplastic agent; sensitivity and specificity; pathology; retrospective study; false negative result; artificial intelligence; surgery; rectal neoplasms; endoscopy; rectum tumor; false positive result; therapy; chemoradiotherapy; induction chemotherapy; artificial neural network; rectal adenocarcinoma; interrater reliability; procedures; consolidation chemotherapy; nonoperative management; locally advanced rectal cancer; humans; prognosis; human; male; female; article; convolutional neural network; total neoadjuvant therapy; neural networks, computer |
| Journal Title: | Annals of Surgical Oncology |
| Volume: | 31 |
| Issue: | 10 |
| ISSN: | 1068-9265 |
| Publisher: | Springer |
| Date Published: | 2024-01-01 |
| Start Page: | 6443 |
| End Page: | 6451 |
| Language: | English |
| DOI: | 10.1245/s10434-024-15311-y |
| PUBMED: | 38700799 |
| PROVIDER: | scopus |
| PMCID: | PMC11600550 |
| DOI/URL: | |
| Notes: | The MSK Cancer Center Support Grant (P30 CA008748) is acknowledge in the PDF -- Corresponding authors is MSK author: J. Garcia-Aguilar -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
Related MSK Work