Subscribe to RSS
DOI: 10.1055/a-2289-9334
Using a customized GPT to provide guideline-based recommendations for management of pancreatic cystic lesions
Abstract
Background and study aims Rising prevalence of pancreatic cysts and inconsistent management guidelines necessitate innovative approaches. New features of large language models (LLMs), namely custom GPT creation, provided by ChatGPT can be utilized to integrate multiple guidelines and settle inconsistencies.
Methods A custom GPT was developed to provide guideline-based management advice for pancreatic cysts. Sixty clinical scenarios were evaluated by both the custom GPT and gastroenterology experts. A consensus was reached between experts and review of guidelines and the accuracy of recommendations provided by the custom GPT was evaluated and compared with experts.
Results The custom GPT aligned with expert recommendations in 87% of scenarios. Initial expert recommendations were correct in 97% and 87% of cases, respectively. No significant difference was observed between the accuracy of custom GPT and the experts. Agreement analysis using Cohen's and Fleiss' Kappa coefficients indicated consistency among experts and the custom GPT.
Conclusions This proof-of-concept study shows the custom GPT's potential to provide accurate, guideline-based recommendations for pancreatic cyst management, comparable to expert opinions. The study highlights the role of advanced features of LLMs in enhancing clinical decision-making in fields with significant practice variability.
Keywords
Pancreas - Endoscopic ultrasonography - Fine-needle aspiration/biopsy - Pancreatobiliary (ERCP/PTCD) - MRCP topicsPublication History
Received: 02 February 2024
Accepted: 15 March 2024
Accepted Manuscript online:
18 March 2024
Article published online:
26 April 2024
© 2024. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Schweber AB, Agarunov E, Brooks C. et al. Prevalence, incidence, and risk of progression of asymptomatic pancreatic cysts in large sample real-world data. Pancreas 2021; 50: 1287-1292 DOI: 10.1097/MPA.0000000000001918. (PMID: 34860813)
- 2 Vege SS, Ziring B, Jain R. et al. American gastroenterological association institute guideline on the diagnosis and management of asymptomatic neoplastic pancreatic cysts. Gastroenterology 2015; 148: 819-822 DOI: 10.1053/j.gastro.2015.01.015. (PMID: 25805375)
- 3 Tanaka M, Fernández-del Castillo C, Kamisawa T. et al. Revisions of international consensus Fukuoka guidelines for the management of IPMN of the pancreas. Pancreatology 2017; 17: 738-753
- 4 Del Chiaro M, Besselink MG, Scholten L. et al. European evidence-based guidelines on pancreatic cystic neoplasms. Gut 2018; 67: 789-804
- 5 Elta GH, Enestvedt BK, Sauer BG. et al. ACG Clinical Guideline: Diagnosis and Management of Pancreatic Cysts. Am J Gastroenterol 2018; 113: 464-479 DOI: 10.1038/ajg.2018.14. (PMID: 29485131)
- 6 van Huijgevoort NCM, del Chiaro M, Wolfgang CL. et al. Diagnosis and management of pancreatic cystic neoplasms: current evidence and guidelines. Nat Rev Gastroenterol Hepatol 2019 1611 2019; 16: 676-689 DOI: 10.1038/s41575-019-0195-x . (PMID: 31527862)
- 7 Schenck RJ, Miller FH, Keswani RN. The Surveillance patterns of incidentally detected pancreatic cysts vary widely and infrequently adhere to guidelines. Pancreas 2019; 48: 883-887 DOI: 10.1097/MPA.0000000000001352. (PMID: 31268984)
- 8 Ray PP. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Physical Syst 2023; 3: 121-154
- 9 Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell 2023; 6: 75 DOI: 10.3389/frai.2023.1169595. (PMID: 37215063)
- 10 Gorelik Y, Ghersin I, Maza I. et al. Harnessing language models for streamlined postcolonoscopy patient management: a novel approach. Gastrointest Endosc 2023; 98: 639-641.e4
- 11 Benoit JRA. ChatGPT for Clinical Vignette Generation, Revision, and Evaluation. medRxiv 2023; 2023.02.04.23285478. DOI: 10.1101/2023.02.04.23285478
- 12 Okasha HH, Awad A, El-Meligui A. et al. Cystic pancreatic lesions, the endless dilemma. World J Gastroenterol 2021; 27: 2664-2680 DOI: 10.3748/wjg.v27.i21.2664. (PMID: 34135548)
- 13 Marchegiani G, Pollini T, Burelli A. et al. Surveillance for presumed BD-IPMN of the pancreas: Stability, size, and age identify targets for discontinuation. Gastroenterology 2023; 165: 1016-1024 DOI: 10.1053/j.gastro.2023.06.022. (PMID: 37406887)