Subscribe to RSS
DOI: 10.1055/a-2236-7849
Deep learning and capsule endoscopy: Automatic multi-brand and multi-device panendoscopic detection of vascular lesions
Abstract
Background and study aims Capsule endoscopy (CE) is commonly used as the initial exam for suspected mid-gastrointestinal bleeding after normal upper and lower endoscopy. Although the assessment of the small bowel is the primary focus of CE, detecting upstream or downstream vascular lesions may also be clinically significant. This study aimed to develop and test a convolutional neural network (CNN)-based model for panendoscopic automatic detection of vascular lesions during CE.
Patients and methods A multicentric AI model development study was based on 1022 CE exams. Our group used 34655 frames from seven types of CE devices, of which 11091 were considered to have vascular lesions (angiectasia or varices) after triple validation. We divided data into a training and a validation set, and the latter was used to evaluate the model’s performance. At the time of division, all frames from a given patient were assigned to the same dataset. Our primary outcome measures were sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and an area under the precision-recall curve (AUC-PR).
Results Sensitivity and specificity were 86.4% and 98.3%, respectively. PPV was 95.2%, while the NPV was 95.0%. Overall accuracy was 95.0%. The AUC-PR value was 0.96. The CNN processed 115 frames per second.
Conclusions This is the first proof-of-concept artificial intelligence deep learning model developed for pan-endoscopic automatic detection of vascular lesions during CE. The diagnostic performance of this CNN in multi-brand devices addresses an essential issue of technological interoperability, allowing it to be replicated in multiple technological settings.
Keywords
Small bowel endoscopy - Small intestinal bleeding - Endoscopy Upper GI Tract - Non-variceal bleeding - Endoscopy Lower GI Tract - Lower GI bleedingPublication History
Received: 31 May 2023
Accepted after revision: 21 December 2023
Accepted Manuscript online:
02 January 2024
Article published online:
23 April 2024
© 2024. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial-License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Triester SL, Leighton JA, Leontiadis GI. et al. A meta-analysis of the yield of capsule endoscopy compared to other diagnostic modalities in patients with obscure gastrointestinal bleeding. Am J Gastroenterol 2005; 100: 2407-2418
- 2 Liao Z, Gao R, Xu C. et al. Indications and detection, completion, and retention rates of small-bowel capsule endoscopy: a systematic review. Gastrointest Endosc 2010; 71: 280-286 DOI: 10.1016/j.gie.2009.09.031. (PMID: 20152309)
- 3 Teshima CW, Kuipers EJ, van Zanten SV. et al. Double balloon enteroscopy and capsule endoscopy for obscure gastrointestinal bleeding: an updated meta-analysis. J Gastroenterol Hepatol 2011; 26: 796-801 DOI: 10.1111/j.1440-1746.2010.06530.x. (PMID: 21155884)
- 4 Marmo R, Rotondano G, Rondonotti E. et al. Capsule enteroscopy vs. other diagnostic procedures in diagnosing obscure gastrointestinal bleeding: a cost-effectiveness study. Eur J Gastroenterol Hepatol 2007; 19: 535-542 DOI: 10.1097/MEG.0b013e32812144dd. (PMID: 17556898)
- 5 Otani K, Watanabe T, Shimada S. et al. Clinical utility of capsule endoscopy and double-balloon enteroscopy in the management of obscure gastrointestinal bleeding. Digestion 2018; 97: 52-58 DOI: 10.1159/000484218. (PMID: 29393257)
- 6 Wang A, Banerjee S, Barth BA. et al. Wireless capsule endoscopy. Gastrointest Endosc 2013; 78: 805-815 DOI: 10.1016/j.gie.2013.06.026. (PMID: 24119509)
- 7 Rondonotti E, Spada C, Adler S. et al. Small-bowel capsule endoscopy and device-assisted enteroscopy for diagnosis and treatment of small-bowel disorders: European Society of Gastrointestinal Endoscopy (ESGE) Technical Review. Endoscopy 2018; 50: 423-446 DOI: 10.1055/a-0576-0566. (PMID: 29539652)
- 8 Cortegoso Valdivia P, Elosua A, Houdeville C. et al. Clinical feasibility of panintestinal (or panenteric) capsule endoscopy: a systematic review. Eur J Gastroenterol Hepatol 2021; 33: 949-955 DOI: 10.1097/MEG.0000000000002200. (PMID: 34034282)
- 9 Ribeiro T, Fernández-Urien I, Cardoso H. Colon capsule endoscopy and artificial intelligence: a perfect match por panendoscopy. In: Mascarenhas MCH, Macedo G. Artificial Intelligence in Capsule Endoscopy. Academic Press; 2023: 255-269 DOI: 10.1016/B978-0-323-99647-1.00007-1
- 10 AmishaMalik P, Pathania M. et al. Overview of artificial intelligence in medicine. J Family Med Prim Care 2019; 8: 2328-2331 DOI: 10.4103/jfmpc.jfmpc_440_19. (PMID: 31463251)
- 11 Leenhardt R, Vasseur P, Li C. et al. A neural network algorithm for detection of GI angiectasia during small-bowel capsule endoscopy. Gastrointest Endosc 2019; 89: 189-194
- 12 Noya F, Alvarez-Gonzalez MA, Benitez R. Automated angiodysplasia detection from wireless capsule endoscopy. Annu Int Conf IEEE Eng Med Biol Soc 2017; 2017: 3158-3161 DOI: 10.1109/EMBC.2017.8037527. (PMID: 29060568)
- 13 Otani K, Nakada A, Kurose Y. et al. Automatic detection of different types of small-bowel lesions on capsule endoscopy images using a newly developed deep convolutional neural network. Endoscopy 2020; 52: 786-791 DOI: 10.1055/a-1167-8157. (PMID: 32557474)
- 14 Ribeiro T, Saraiva MM, Ferreira JPS. et al. Artificial intelligence and capsule endoscopy: automatic detection of vascular lesions using a convolutional neural network. Ann Gastroenterol 2021; 34: 820-828 DOI: 10.20524/aog.2021.0653. (PMID: 34815648)
- 15 Tsuboi A, Oka S, Aoyama K. et al. Artificial intelligence using a convolutional neural network for automatic detection of small-bowel angioectasia in capsule endoscopy images. Dig Endosc 2020; 32: 382-390 DOI: 10.1111/den.13507. (PMID: 31392767)
- 16 Saurin JC, Delvaux M, Gaudin JL. et al. Diagnostic value of endoscopic capsule in patients with obscure digestive bleeding: blinded comparison with video push-enteroscopy. Endoscopy 2003; 35: 576-584
- 17 Radosavovic I, Kosaraju RP, Girshick RB. et al. Designing Network Design Spaces. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020
- 18 Fu GH, Yi LZ, Pan J. Tuning model parameters in class-imbalanced learning with precision-recall curve. Biom J 2019; 61: 652-664 DOI: 10.1002/bimj.201800148. (PMID: 30548291)
- 19 Pedregosa FVGGA, Michel V, Thirion B. et al. Scikit-learn: Machine Learning in Python. J Mach Learn 2011; 12: 2825-2830
- 20 Mascarenhas Saraiva M, Ferreira JPS, Cardoso H. et al. Artificial intelligence and colon capsule endoscopy: automatic detection of blood in colon capsule endoscopy using a convolutional neural network. Endosc Int Open 2021; 9: E1264-E1268
- 21 Mascarenhas M, Ribeiro T, Afonso J. et al. Deep learning and colon capsule endoscopy: automatic detection of blood and colonic mucosal lesions using a convolutional neural network. Endosc Int Open 2022; 10: E171-E177 DOI: 10.1055/a-1675-1941. (PMID: 35186665)