Authors: | Geevarghese, R.; Sigel, C.; Cadley, J.; Chatterjee, S.; Jain, P.; Hollingsworth, A.; Chatterjee, A.; Swinburne, N.; Bilal, K. H.; Marinelli, B. |
Article Title: | Extraction and classification of structured data from unstructured hepatobiliary pathology reports using large language models: A feasibility study compared with rules-based natural language processing |
Abstract: | Aims Structured reporting in pathology is not universally adopted and extracting elements essential to research often requires expensive and time-intensive manual curation. The accuracy and feasibility of using large language models (LLMs) to extract essential pathology elements, for cancer research is examined here. Methods Retrospective study of patients who underwent pathology sampling for suspected hepatocellular carcinoma and underwent Ytrrium-90 embolisation. Five pathology report elements of interest were included for evaluation. LLMs (Generative Pre-trained Transformer (GPT) 3.5 turbo and GPT-4) were used to extract elements of interest. For comparison, a rules-based, regular expressions (REGEX) approach was devised for extraction. Accuracy for each approach was calculated. Results 88 pathology reports were identified. LLMs and REGEX were both able to extract research elements with high accuracy (average 84.1%-94.8%). Conclusions LLMs have significant potential to simplify the extraction of research elements from pathology reporting, and therefore, accelerate the pace of cancer research. © Author(s) (or their employer(s)) 2025. |
Keywords: | controlled study; retrospective studies; major clinical study; liver cell carcinoma; carcinoma, hepatocellular; liver neoplasms; cancer patient; comparative study; cohort analysis; pathology; retrospective study; cancer research; liver; feasibility study; feasibility studies; artificial intelligence; liver tumor; hepatobiliary disease; yttrium 90; natural language processing; data extraction; humans; human; article; artificial embolization; data accuracy; large language model; data classification; generative pretrained transformer |
Journal Title: | Journal of Clinical Pathology |
Volume: | 78 |
Issue: | 2 |
ISSN: | 0021-9746 |
Publisher: | BMJ Publishing Group Ltd. |
Date Published: | 2025-02-01 |
Start Page: | 135 |
End Page: | 138 |
Language: | English |
DOI: | 10.1136/jcp-2024-209669 |
PUBMED: | 39304201 |
PROVIDER: | scopus |
DOI/URL: | |
Notes: | Article -- Source: Scopus |