A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology
Abstract
:1. Introduction
2. Artificial Intelligence
3. Pharyngeal Cancer
4. Upper Gastrointestinal Diseases
4.1. Esophageal Cancer
4.2. Gastric Cancer
4.3. Helicobacter pylori Infection and Gastric Atrophy
4.4. Upper Gastrointestinal Bleeding
4.5. Quality Control
5. Gastrointestinal Stromal Tumor (GIST)
6. Duodenal and Small Intestinal Lesions
7. Colon Cancer and Polyps
8. Inflammatory Bowel Disease
9. Irritable Bowel Syndrome (IBS)
10. Liver Diseases
10.1. Liver Masses
10.2. Nonalcoholic Fatty Liver Disease (NAFLD)
10.3. Viral Hepatitis
10.4. Primary Sclerosing Cholangitis (PSC)
10.5. Liver Transplantation
11. Pancreatic Disease
11.1. Pancreatic Cancer
11.2. Intraductal Papillary Mucinous Neoplasm (IPMN)
11.3. Autoimmune Pancreatitis (AIP)
12. Future Needs and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Acknowledgments
Conflicts of Interest
References
- Benaich, N.; Hogarth, I. The State of AI Report. 2020. Available online: https://www.stateof.ai/ (accessed on 19 September 2021).
- Wang, A.; Nguyen, D.; Sridhar, A.R.; Gollakota, S. Using smart speakers to contactlessly monitor heart rhythms. Commun. Biol. 2021, 4, 319. [Google Scholar] [CrossRef]
- Ardila, D.; Kiraly, A.P.; Bharadwaj, S.; Choi, B.; Reicher, J.J.; Peng, L.; Tse, D.; Etemadi, M.; Ye, W.; Corrado, G.; et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat. Med. 2019, 25, 954–961. [Google Scholar] [CrossRef]
- Haenssle, H.A.; Fink, C.; Schneiderbauer, R.; Toberer, F.; Buhl, T.; Blum, A.; Kalloo, A.; Hassen, A.B.H.; Thomas, L.; Enk, A.; et al. Man against machine: Diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann. Oncol. 2018, 29, 1836–1842. [Google Scholar] [CrossRef] [PubMed]
- IEEE. AI vs. Doctors. Available online: https://spectrum.ieee.org/static/ai-vs-doctors (accessed on 20 April 2021).
- Jordan, M.I.; Mitchell, T.M. Machine learning: Trends, perspectives, and prospects. Science 2015, 349, 255–260. [Google Scholar] [CrossRef] [PubMed]
- Topol, E.J. High-performance medicine: The convergence of human and artificial intelligence. Nat. Med. 2019, 25, 44–56. [Google Scholar] [CrossRef] [PubMed]
- Stokes, J.M.; Yang, K.; Swanson, K.; **, W.; Cubillos-Ruiz, A.; Donghia, N.M.; MacNair, C.R.; French, S.; Carfrae, L.A.; Bloom-Ackermann, Z.; et al. A deep learning approach to antibiotic discovery. Cell 2020, 180, 688–702.e13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Coudray, N.; Ocampo, P.S.; Sakellaropoulos, T.; Narula, N.; Snuderl, M.; Fenyö, D.; Moreira, A.L.; Razavian, N.; Tsirigos, A. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat. Med. 2018, 24, 1559–1567. [Google Scholar] [CrossRef]
- Hamilton, J.G.; Genoff Garzon, M.; Westerman, J.S.; Shuk, E.; Hay, J.L.; Walters, C.; Elkin, E.; Bertelsen, C.; Cho, J.; Daly, B.; et al. “A tool, not a crutch”: Patient perspectives about IBM Watson for oncology trained by memorial sloan kettering. J. Oncol. Pract. 2019, 15, e277–e288. [Google Scholar] [CrossRef]
- IBM. IBM Watson Products. Available online: https://www.ibm.com/watson/products-services (accessed on 19 September 2021).
- Parasa, S.; Wallace, M.; Bagci, U.; Antonino, M.; Berzin, T.; Byrne, M.; Celik, H.; Farahani, K.; Golding, M.; Gross, S.; et al. Proceedings from the First Global Artificial Intelligence in Gastroenterology and Endoscopy Summit. Gastrointest. Endosc. 2020, 92, 938–945.e1. [Google Scholar] [CrossRef]
- Turing, A.M. Computing machinery and intelligence. Mind 1950, 59, 433–460. [Google Scholar] [CrossRef]
- McCarthy, J.; Minsky, M.L.; Rochester, N.; Shannon, C.E. A proposal for the Dartmouth summer research project on artificial intelligence. Al Mag. 2006, 27, 12–14. [Google Scholar]
- Samuel, A.L. Some studies in machine learning using the game of checkers. IBM J. Res. Dev. 1959, 44, 210–229. [Google Scholar] [CrossRef]
- Camacho, D.M.; Collins, K.M.; Powers, R.K.; Costello, J.C.; Collins, J.J. Next-generation machine learning for biological networks. Cell 2018, 173, 1581–1592. [Google Scholar] [CrossRef] [Green Version]
- Hinton, G.E. Reducing the dimensionality of data with neural networks. Science 2006, 313, 504–507. [Google Scholar] [CrossRef] [Green Version]
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet classification with deep convolutional neural networks. Commun. ACM 2017, 60, 84–90. [Google Scholar] [CrossRef]
- Hosny, A.; Parmar, C.; Quackenbush, J.; Schwartz, L.H.; Aerts, H.J.W.L. Artificial intelligence in radiology. Nat. Rev. Cancer 2018, 18, 500–510. [Google Scholar] [CrossRef] [PubMed]
- Min, J.K.; Kwak, M.S.; Cha, J.M. Overview of deep learning in gastrointestinal endoscopy. Gut Liver 2019, 13, 388–393. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hassan, T.M.; Elmogy, M.; Sallam, E.-S. Diagnosis of focal liver diseases based on deep learning technique for ultrasound images. Arab. J. Sci. Eng. 2017, 42, 3127–3140. [Google Scholar] [CrossRef]
- Forte, C.; Voinea, A.; Chichirau, M.; Yeshmagambetova, G.; Albrecht, L.M.; Erfurt, C.; Freundt, L.A.; Carmo, L.O.E.; Henning, R.H.; van der Horst, I.C.C.; et al. Deep learning for identification of acute illness and facial cues of illness. Front. Med. 2021, 8, 661309. [Google Scholar] [CrossRef] [PubMed]
- Jia, X.; Meng, M.Q.H. A deep convolutional neural network for bleeding detection in Wireless Capsule Endoscopy images. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; Volume 2016, pp. 639–642. [Google Scholar]
- Silver, D.; Huang, A.; Maddison, C.J.; Guez, A.; Sifre, L.; Van Den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; et al. Mastering the game of Go with deep neural networks and tree search. Nature 2016, 529, 484–489. [Google Scholar] [CrossRef]
- FDA. FDA Permits Marketing of Artificial Intelligence-Based Device to Detect Certain Diabetes-Related Eye Problems. Available online: https://www.fda.gov/news-events/press-announcements/fda-permits-marketing-artificial-intelligence-based-device-detect-certain-diabetes-related-eye (accessed on 19 September 2021).
- Liang, H.; ** of gastric cancer for TNM classification: International Gastric Cancer Association staging project. Gastric Cancer 2017, 20, 217–225. [Google Scholar] [CrossRef]
- Rice, T.W.; Ishwaran, H.; Hofstetter, W.L.; Kelsen, D.P.; Apperson-Hansen, C.; Blackstone, E.H. Recommendations for pathologic staging (pTNM) of cancer of the esophagus and esophagogastric junction for the 8th edition AJCC/UICC staging manuals. Dis. Esophagus 2016, 29, 897–905. [Google Scholar] [CrossRef] [Green Version]
- Hosokawa, O.; Tsuda, S.; Kidani, E.; Watanabe, K.; Tanigawa, Y.; Shirasaki, S.; Hayashi, H.; Hinoshita, T. Diagnosis of gastric cancer up to three years after negative upper gastrointestinal endoscopy. Endoscopy 1998, 30, 669–674. [Google Scholar] [CrossRef]
- Sung, H.; Ferlay, J.; Siegel, R.L.; Laversanne, M.; Soerjomataram, I.; Jemal, A.; Bray, F. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA. Cancer J. Clin. 2021, 71, 209–249. [Google Scholar] [CrossRef] [PubMed]
- Tokai, Y.; Yoshio, T.; Aoyama, K.; Horie, Y.; Yoshimizu, S.; Horiuchi, Y.; Ishiyama, A.; Tsuchida, T.; Hirasawa, T.; Sakakibara, Y.; et al. Application of artificial intelligence using convolutional neural networks in determining the invasion depth of esophageal squamous cell carcinoma. Esophagus 2020, 17, 250–256. [Google Scholar] [CrossRef]
- Horie, Y.; Yoshio, T.; Aoyama, K.; Yoshimizu, S.; Horiuchi, Y.; Ishiyama, A.; Hirasawa, T.; Tsuchida, T.; Ozawa, T.; Ishihara, S.; et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest. Endosc. 2019, 89, 25–32. [Google Scholar] [CrossRef] [PubMed]
- Ohmori, M.; Ishihara, R.; Aoyama, K.; Nakagawa, K.; Iwagami, H.; Matsuura, N.; Shichijo, S.; Yamamoto, K.; Nagaike, K.; Nakahara, M.; et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest. Endosc. 2020, 91, 301–309.e1. [Google Scholar] [CrossRef] [PubMed]
- Nakagawa, K.; Ishihara, R.; Aoyama, K.; Ohmori, M.; Nakahira, H.; Matsuura, N.; Shichijo, S.; Nishida, T.; Yamada, T.; Yamaguchi, S.; et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest. Endosc. 2019, 90, 407–414. [Google Scholar] [CrossRef] [PubMed]
- Luo, H.; Xu, G.; Li, C.; He, L.; Luo, L.; Wang, Z.; **g, B.; Deng, Y.; **, Y.; Li, Y.; et al. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: A multicentre, case-control, diagnostic study. Lancet Oncol. 2019, 20, 1645–1654. [Google Scholar] [CrossRef]
- Ferlay, J.; Colombet, M.; Soerjomataram, I.; Mathers, C.; Parkin, D.M.; Piñeros, M.; Znaor, A.; Bray, F. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int. J. Cancer 2019, 144, 1941–1953. [Google Scholar] [CrossRef] [Green Version]
- de Groof, J.; van der Sommen, F.; van der Putten, J.; Struyvenberg, M.R.; Zinger, S.; Curvers, W.L.; Pech, O.; Meining, A.; Neuhaus, H.; Bisschops, R.; et al. The Argos project: The development of a computer-aided detection system to improve detection of Barrett’s neoplasia on white light endoscopy. United Eur. Gastroenterol. J. 2019, 7, 538–547. [Google Scholar] [CrossRef] [Green Version]
- De Groof, A.J.; Struyvenberg, M.R.; van der Putten, J.; van der Sommen, F.; Fockens, K.N.; Curvers, W.L.; Zinger, S.; Pouw, R.E.; Coron, E.; Baldaque-Silva, F.; et al. Deep-learning system detects neoplasia in patients with barrett’s esophagus with higher accuracy than endoscopists in a multistep training and validation study with benchmarking. Gastroenterology 2020, 158, 915–929.e4. [Google Scholar] [CrossRef]
- Hashimoto, R.; Requa, J.; Dao, T.; Ninh, A.; Tran, E.; Mai, D.; Lugo, M.; El-Hage Chehade, N.; Chang, K.J.; Karnes, W.E.; et al. Artificial intelligence using convolutional neural networks for real-time detection of early esophageal neoplasia in Barrett’s esophagus (with video). Gastrointest. Endosc. 2020, 91, 1264–1271.e1. [Google Scholar] [CrossRef]
- Arribas, J.; Antonelli, G.; Frazzoni, L.; Fuccio, L.; Ebigbo, A.; van der Sommen, F.; Ghatwary, N.; Palm, C.; Coimbra, M.; Renna, F.; et al. Standalone performance of artificial intelligence for upper GI neoplasia: A meta-analysis. Gut 2021, 70, 1458–1468. [Google Scholar] [CrossRef]
- van der Sommen, F.; Zinger, S.; Curvers, W.; Bisschops, R.; Pech, O.; Weusten, B.; Bergman, J.; de With, P.; Schoon, E. Computer-aided detection of early neoplastic lesions in Barrett’s esophagus. Endoscopy 2016, 48, 617–624. [Google Scholar] [CrossRef] [Green Version]
- Swager, A.-F.; van der Sommen, F.; Klomp, S.R.; Zinger, S.; Meijer, S.L.; Schoon, E.J.; Bergman, J.J.G.H.M.; de With, P.H.; Curvers, W.L. Computer-aided detection of early Barrett’s neoplasia using volumetric laser endomicroscopy. Gastrointest. Endosc. 2017, 86, 839–846. [Google Scholar] [CrossRef] [Green Version]
- Fonollà, R.; Scheeve, T.; Struyvenberg, M.R.; Curvers, W.L.; de Groof, A.J.; van der Sommen, F.; Schoon, E.J.; Bergman, J.J.G.H.M.; de With, P.H.N. Ensemble of deep convolutional neural networks for classification of early Barrett’s neoplasia using volumetric laser endomicroscopy. Appl. Sci. 2019, 9, 2183. [Google Scholar] [CrossRef] [Green Version]
- Ebigbo, A.; Mendel, R.; Probst, A.; Manzeneder, J.; de Souza, L.A., Jr.; Papa, J.P.; Palm, C.; Messmann, H. Computer-aided diagnosis using deep learning in the evaluation of early oesophageal adenocarcinoma. Gut 2019, 68, 1143–1145. [Google Scholar] [CrossRef] [Green Version]
- Ebigbo, A.; Mendel, R.; Probst, A.; Manzeneder, J.; Prinz, F.; de Souza, L.A., Jr.; Papa, J.; Palm, C.; Messmann, H. Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus. Gut 2020, 69, 615–616. [Google Scholar] [CrossRef] [PubMed]
- Allum, W.H.; Blazeby, J.M.; Griffin, S.M.; Cunningham, D.; Jankowski, J.A.; Wong, R.; Association of Upper Gastrointestinal Surgeons of Great Britain and Ireland. Guidelines for the management of oesophageal and gastric cancer. Gut 2011, 60, 1449–1472. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Wu, L.; Zhou, W.; Wan, X.; Zhang, J.; Shen, L.; Hu, S.; Ding, Q.; Mu, G.; Yin, A.; Huang, X.; et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy 2019, 51, 522–531. [Google Scholar] [CrossRef] [Green Version]
- Horiuchi, Y.; Hirasawa, T.; Ishizuka, N.; Tokai, Y.; Namikawa, K.; Yoshimizu, S.; Ishiyama, A.; Yoshio, T.; Tsuchida, T.; Fujisaki, J.; et al. Performance of a computer-aided diagnosis system in diagnosing early gastric cancer using magnifying endoscopy videos with narrow-band imaging (with videos). Gastrointest. Endosc. 2020, 92, 856–865.e1. [Google Scholar] [CrossRef] [PubMed]
- Ikenoyama, Y.; Hirasawa, T.; Ishioka, M.; Namikawa, K.; Yoshimizu, S.; Horiuchi, Y.; Ishiyama, A.; Yoshio, T.; Tsuchida, T.; Takeuchi, Y.; et al. Detecting early gastric cancer: Comparison between the diagnostic ability of convolutional neural networks and endoscopists. Dig. Endosc. 2021, 33, 141–150. [Google Scholar] [CrossRef] [PubMed]
- Horiuchi, Y.; Tokai, Y.; Yamamoto, N.; Yoshimizu, S.; Ishiyama, A.; Yoshio, T.; Hirasawa, T.; Yamamoto, Y.; Nagahama, M.; Takahashi, H.; et al. Additive effect of magnifying endoscopy with narrow-band imaging for diagnosing mixed-type early gastric cancers. Dig. Dis. Sci. 2020, 65, 591–599. [Google Scholar] [CrossRef]
- Horiuchi, Y.; Aoyama, K.; Tokai, Y.; Hirasawa, T.; Yoshimizu, S.; Ishiyama, A.; Yoshio, T.; Tsuchida, T.; Fujisaki, J.; Tada, T. Convolutional neural network for differentiating gastric cancer from gastritis using magnified endoscopy with narrow band imaging. Dig. Dis. Sci. 2020, 65, 1355–1363. [Google Scholar] [CrossRef]
- Miyaki, R.; Yoshida, S.; Tanaka, S.; Kominami, Y.; Sanomura, Y.; Matsuo, T.; Oka, S.; Raytchev, B.; Tamaki, T.; Koide, T.; et al. Quantitative identification of mucosal gastric cancer under magnifying endoscopy with flexible spectral imaging color enhancement. J. Gastroenterol. Hepatol. 2013, 28, 841–847. [Google Scholar] [CrossRef]
- Kanesaka, T.; Lee, T.-C.; Uedo, N.; Lin, K.-P.; Chen, H.-Z.; Lee, J.-Y.; Wang, H.-P.; Chang, H.-T. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest. Endosc. 2018, 87, 1339–1344. [Google Scholar] [CrossRef]
- Kubota, K.; Kuroda, J.; Yoshida, M.; Ohta, K.; Kitajima, M. Medical image analysis: Computer-aided diagnosis of gastric cancer invasion on endoscopic images. Surg. Endosc. 2012, 26, 1485–1489. [Google Scholar] [CrossRef]
- Zhu, Y.; Wang, Q.-C.; Xu, M.-D.; Zhang, Z.; Cheng, J.; Zhong, Y.-S.; Zhang, Y.-Q.; Chen, W.-F.; Yao, L.-Q.; Zhou, P.-H.; et al. Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy. Gastrointest. Endosc. 2019, 89, 806–815.e1. [Google Scholar] [CrossRef]
- Yoon, H.J.; Kim, S.; Kim, J.-H.; Keum, J.-S.; Oh, S.-I.; Jo, J.; Chun, J.; Youn, Y.H.; Park, H.; Kwon, I.G.; et al. A lesion-based convolutional neural network improves endoscopic detection and depth prediction of early gastric cancer. J. Clin. Med. 2019, 8, 1310. [Google Scholar] [CrossRef] [Green Version]
- Uemura, N.; Okamoto, S.; Yamamoto, S.; Matsumura, N.; Yamaguchi, S.; Yamakido, M.; Taniyama, K.; Sasaki, N.; Schlemper, R.J. Helicobacter pylori infection and the development of gastric cancer. N. Engl. J. Med. 2001, 345, 784–789. [Google Scholar] [CrossRef]
- Watanabe, K.; Nagata, N.; Shimbo, T.; Nakashima, R.; Furuhata, E.; Sakurai, T.; Akazawa, N.; Yokoi, C.; Kobayakawa, M.; Akiyama, J.; et al. Accuracy of endoscopic diagnosis of Helicobacter pyloriinfection according to level of endoscopic experience and the effect of training. BMC Gastroenterol. 2013, 13, 128. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Shichijo, S.; Nomura, S.; Aoyama, K.; Nishikawa, Y.; Miura, M.; Shinagawa, T.; Takiyama, H.; Tanimoto, T.; Ishihara, S.; Matsuo, K.; et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine 2017, 25, 106–111. [Google Scholar] [CrossRef] [Green Version]
- Shichijo, S.; Endo, Y.; Aoyama, K.; Takeuchi, Y.; Ozawa, T.; Takiyama, H.; Matsuo, K.; Fujishiro, M.; Ishihara, S.; Ishihara, R.; et al. Application of convolutional neural networks for evaluating Helicobacter pylori infection status on the basis of endoscopic images. Scand. J. Gastroenterol. 2019, 54, 158–163. [Google Scholar] [CrossRef] [PubMed]
- Nakashima, H.; Kawahira, H.; Kawachi, H.; Sakaki, N. Endoscopic three-categorical diagnosis of Helicobacter pylori infection using linked color imaging and deep learning: A single-center prospective study (with video). Gastric Cancer 2020, 23, 1033–1040. [Google Scholar] [CrossRef]
- Nakahira, H.; Ishihara, R.; Aoyama, K.; Kono, M.; Fukuda, H.; Shimamoto, Y.; Nakagawa, K.; Ohmori, M.; Iwatsubo, T.; Iwagami, H.; et al. Stratification of gastric cancer risk using a deep neural network. JGH Open 2020, 4, 466–471. [Google Scholar] [CrossRef]
- Shung, D.; Simonov, M.; Gentry, M.; Au, B.; Laine, L. Machine learning to predict outcomes in patients with acute gastrointestinal bleeding: A systematic review. Dig. Dis. Sci. 2019, 64, 2078–2087. [Google Scholar] [CrossRef]
- Shung, D.L.; Au, B.; Taylor, R.A.; Tay, J.K.; Laursen, S.B.; Stanley, A.J.; Dalton, H.R.; Ngu, J.; Schultz, M.; Laine, L. Validation of a machine learning model that outperforms clinical risk scoring systems for upper gastrointestinal bleeding. Gastroenterology 2020, 158, 160–167. [Google Scholar] [CrossRef]
- Yao, K.; Uedo, N.; Kamada, T.; Hirasawa, T.; Nagahama, T.; Yoshinaga, S.; Oka, M.; Inoue, K.; Mabe, K.; Yao, T.; et al. Guidelines for endoscopic diagnosis of early gastric cancer. Dig. Endosc. 2020, 32, 663–698. [Google Scholar] [CrossRef] [PubMed]
- Wu, L.; Zhang, J.; Zhou, W.; An, P.; Shen, L.; Liu, J.; Jiang, X.; Huang, X.; Mu, G.; Wan, X.; et al. Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy. Gut 2019, 68, 2161–2169. [Google Scholar] [CrossRef] [Green Version]
- Chen, D.; Wu, L.; Li, Y.; Zhang, J.; Liu, J.; Huang, L.; Jiang, X.; Huang, X.; Mu, G.; Hu, S.; et al. Comparing blind spots of unsedated ultrafine, sedated, and unsedated conventional gastroscopy with and without artificial intelligence: A prospective, single-blind, 3-parallel-group, randomized, single-center trial. Gastrointest. Endosc. 2020, 91, 332–339.e3. [Google Scholar] [CrossRef] [PubMed]
- Minoda, Y.; Ihara, E.; Komori, K.; Ogino, H.; Otsuka, Y.; Chinen, T.; Tsuda, Y.; Ando, K.; Yamamoto, H.; Ogawa, Y. Efficacy of endoscopic ultrasound with artificial intelligence for the diagnosis of gastrointestinal stromal tumors. J. Gastroenterol. 2020, 55, 1119–1126. [Google Scholar] [CrossRef]
- Inoue, S.; Shichijo, S.; Aoyama, K.; Kono, M.; Fukuda, H.; Shimamoto, Y.; Nakagawa, K.; Ohmori, M.; Iwagami, H.; Matsuno, K.; et al. Application of convolutional neural networks for detection of superficial nonampullary duodenal epithelial tumors in esophagogastroduodenoscopic images. Clin. Transl. Gastroenterol. 2020, 11, e00154. [Google Scholar] [CrossRef] [PubMed]
- Triester, S.L.; Leighton, J.A.; Leontiadis, G.I.; Fleischer, D.E.; Hara, A.K.; Heigh, R.I.; Shiff, A.D.; Sharma, V.K. A meta-analysis of the yield of capsule endoscopy compared to other diagnostic modalities in patients with obscure gastrointestinal bleeding. Am. J. Gastroenterol. 2005, 100, 2407–2418. [Google Scholar] [CrossRef] [PubMed]
- McAlindon, M.E.; Ching, H.-L.; Yung, D.; Sidhu, R.; Koulaouzidis, A. Capsule endoscopy of the small bowel. Ann. Transl. Med. 2016, 4, 369. [Google Scholar] [CrossRef] [Green Version]
- Lewis, B.S. Expanding role of capsule endoscopy in inflammatory bowel disease. World J. Gastroenterol. 2008, 14, 4137. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kumar, R.; Qian, Z.; Seshamani, S.; Mullin, G.; Hager, G.; Dassopoulos, T. Assessment of Crohn’s disease lesions in wireless capsule endoscopy images. IEEE Trans. Biomed. Eng. 2012, 59, 355–362. [Google Scholar] [CrossRef] [PubMed]
- Trasolini, R.; Byrne, M.F. Artificial intelligence and deep learning for small bowel capsule endoscopy. Dig. Endosc. 2021, 33, 290–297. [Google Scholar] [CrossRef]
- Boal Carvalho, P.; Magalhães, J.; Dias de Castro, F.; Monteiro, S.; Rosa, B.; Moreira, M.J.; Cotter, J. Suspected blood indicator in capsule endoscopy: A valuable tool for gastrointestinal bleeding diagnosis. Arq. Gastroenterol. 2017, 54, 16–20. [Google Scholar] [CrossRef] [Green Version]
- Hassan, A.R.; Haque, M.A. Computer-aided gastrointestinal hemorrhage detection in wireless capsule endoscopy videos. Comput. Methods Programs Biomed. 2015, 122, 341–353. [Google Scholar] [CrossRef]
- Aoki, T.; Yamada, A.; Kato, Y.; Saito, H.; Tsuboi, A.; Nakada, A.; Niikura, R.; Fujishiro, M.; Oka, S.; Ishihara, S.; et al. Automatic detection of blood content in capsule endoscopy images based on a deep convolutional neural network. J. Gastroenterol. Hepatol. 2020, 35, 1196–1200. [Google Scholar] [CrossRef]
- Aoki, T.; Yamada, A.; Kato, Y.; Saito, H.; Tsuboi, A.; Nakada, A.; Niikura, R.; Fujishiro, M.; Oka, S.; Ishihara, S.; et al. Automatic detection of various abnormalities in capsule endoscopy videos by a deep learning-based system: A multicenter study. Gastrointest. Endosc. 2021, 93, 165–173.e1. [Google Scholar] [CrossRef]
- Aoki, T.; Yamada, A.; Aoyama, K.; Saito, H.; Tsuboi, A.; Nakada, A.; Niikura, R.; Fujishiro, M.; Oka, S.; Ishihara, S.; et al. Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network. Gastrointest. Endosc. 2019, 89, 357–363.e2. [Google Scholar] [CrossRef]
- Aoki, T.; Yamada, A.; Aoyama, K.; Saito, H.; Fujisawa, G.; Odawara, N.; Kondo, R.; Tsuboi, A.; Ishibashi, R.; Nakada, A.; et al. Clinical usefulness of a deep learning-based system as the first screening on small-bowel capsule endoscopy reading. Dig. Endosc. 2020, 32, 585–591. [Google Scholar] [CrossRef] [PubMed]
- Zauber, A.G.; Winawer, S.J.; O’Brien, M.J.; Lansdorp-Vogelaar, I.; van Ballegooijen, M.; Hankey, B.F.; Shi, W.; Bond, J.H.; Schapiro, M.; Panish, J.F.; et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N. Engl. J. Med. 2012, 366, 687–696. [Google Scholar] [CrossRef]
- Kumar, S.; Thosani, N.; Ladabaum, U.; Friedland, S.; Chen, A.M.; Kochar, R.; Banerjee, S. Adenoma miss rates associated with a 3-minute versus 6-minute colonoscopy withdrawal time: A prospective, randomized trial. Gastrointest. Endosc. 2017, 85, 1273–1280. [Google Scholar] [CrossRef]
- Van Rijn, J.C.; Reitsma, J.B.; Stoker, J.; Bossuyt, P.M.; van Deventer, S.J.; Dekker, E. Polyp miss rate determined by tandem colonoscopy: A systematic review. Am. J. Gastroenterol. 2006, 101, 343–350. [Google Scholar] [CrossRef]
- Misawa, M.; Kudo, S.; Mori, Y.; Cho, T.; Kataoka, S.; Yamauchi, A.; Ogawa, Y.; Maeda, Y.; Takeda, K.; Ichimasa, K.; et al. Artificial intelligence-assisted polyp detection for colonoscopy: Initial experience. Gastroenterology 2018, 154, 2027–2029.e3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Urban, G.; Tripathi, P.; Alkayali, T.; Mittal, M.; Jalali, F.; Karnes, W.; Baldi, P. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 2018, 155, 1069–1078.e8. [Google Scholar] [CrossRef] [PubMed]
- Misawa, M.; Kudo, S.; Mori, Y.; Hotta, K.; Ohtsuka, K.; Matsuda, T.; Saito, S.; Kudo, T.; Baba, T.; Ishida, F.; et al. Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointest. Endosc. 2021, 93, 960–967.e3. [Google Scholar] [CrossRef]
- Wang, P.; Berzin, T.M.; Glissen Brown, J.R.; Bharadwaj, S.; Becq, A.; ** cirrhosis in patients with chronic hepatitis C. Hepatology 2007, 46, 297–306. [Google Scholar] [CrossRef] [PubMed]
- Lara, J.; López-Labrador, F.X.; González-Candelas, F.; Berenguer, M.; Khudyakov, Y.E. Computational models of liver fibrosis progression for hepatitis C virus chronic infection. BMC Bioinform. 2014, 15, S5. [Google Scholar] [CrossRef] [Green Version]
- Shousha, H.I.; Awad, A.H.; Omran, D.A.; Elnegouly, M.M.; Mabrouk, M. Data mining and machine learning algorithms using IL28B genotype and biochemical markers best predicted advanced liver fibrosis in chronic hepatitis C. Jpn. J. Infect. Dis. 2018, 71, 51–57. [Google Scholar] [CrossRef] [Green Version]
- Wei, R.; Wang, J.; Wang, X.; **e, G.; Wang, Y.; Zhang, H.; Peng, C.-Y.; Rajani, C.; Kwee, S.; Liu, P.; et al. Clinical prediction of HBV and HCV related hepatic fibrosis using machine learning. EBioMedicine 2018, 35, 124–132. [Google Scholar] [CrossRef] [Green Version]
- Konerman, M.A.; Lu, D.; Zhang, Y.; Thomson, M.; Zhu, J.; Verma, A.; Liu, B.; Talaat, N.; Balis, U.; Higgins, P.D.R.; et al. Assessing risk of fibrosis progression and liver-related clinical outcomes among patients with both early stage and advanced chronic hepatitis C. PLoS ONE 2017, 12, e0187344. [Google Scholar] [CrossRef] [Green Version]
- Oh, T.G.; Kim, S.M.; Caussy, C.; Fu, T.; Guo, J.; Bassirian, S.; Singh, S.; Madamba, E.V.; Bettencourt, R.; Richards, L.; et al. A universal gut-microbiome-derived signature predicts cirrhosis. Cell Metab. 2020, 32, 878–888.e6. [Google Scholar] [CrossRef]
- Barnabas, A.; Chapman, R.W. Primary Sclerosing Cholangitis: Is any treatment worthwhile? Curr. Gastroenterol. Rep. 2012, 14, 17–24. [Google Scholar] [CrossRef]
- Eaton, J.E.; Vesterhus, M.; McCauley, B.M.; Atkinson, E.J.; Schlicht, E.M.; Juran, B.D.; Gossard, A.A.; LaRusso, N.F.; Gores, G.J.; Karlsen, T.H.; et al. Primary Sclerosing Cholangitis Risk Estimate Tool (PREsTo) predicts outcomes of the disease: A derivation and validation study using machine learning. Hepatology 2020, 71, 214–224. [Google Scholar] [CrossRef] [PubMed]
- Halldorson, J.B.; Bakthavatsalam, R.; Fix, O.; Reyes, J.D.; Perkins, J.D. D-MELD, a simple predictor of post liver transplant mortality for optimization of donor/recipient matching. Am. J. Transplant. 2009, 9, 318–326. [Google Scholar] [CrossRef] [PubMed]
- Croome, K.P.; Marotta, P.; Wall, W.J.; Dale, C.; Levstik, M.A.; Chandok, N.; Hernandez-Alejandro, R. Should a lower quality organ go to the least sick patient? Model for end-stage liver disease score and donor risk index as predictors of early allograft dysfunction. Transplant. Proc. 2012, 44, 1303–1306. [Google Scholar] [CrossRef] [PubMed]
- Briceño, J.; Cruz-Ramírez, M.; Prieto, M.; Navasa, M.; De Urbina, J.O.; Orti, R.; Gómez-Bravo, M.Á.; Otero, A.; Varo, E.; Tomé, S.; et al. Use of artificial intelligence as an innovative donor-recipient matching model for liver transplantation: Results from a multicenter Spanish study. J. Hepatol. 2014, 61, 1020–1028. [Google Scholar] [CrossRef]
- Ayllón, M.D.; Ciria, R.; Cruz-Ramírez, M.; Pérez-Ortiz, M.; Gómez, I.; Valente, R.; O’Grady, J.; de la Mata, M.; Hervás-Martínez, C.; Heaton, N.D.; et al. Validation of artificial neural networks as a methodology for donor-recipient matching for liver transplantation. Liver Transpl. 2018, 24, 192–203. [Google Scholar] [CrossRef] [Green Version]
- Lau, L.; Kankanige, Y.; Rubinstein, B.; Jones, R.; Christophi, C.; Muralidharan, V.; Bailey, J. Machine-learning algorithms predict graft failure after liver transplantation. Transplantation 2017, 101, e125–e132. [Google Scholar] [CrossRef]
- Bhat, V.; Tazari, M.; Watt, K.D.; Bhat, M. New-onset diabetes and preexisting diabetes are associated with comparable reduction in long-term survival after liver transplant: A machine learning approach. Mayo Clin. Proc. 2018, 93, 1794–1802. [Google Scholar] [CrossRef] [PubMed]
- Davidson, J.; Wilkinson, A.; Dantal, J.; Dotta, F.; Haller, H.; Hernandez, D.; Kasiske, B.L.; Kiberd, B.; Krentz, A.; Legendre, C.; et al. New-onset diabetes after transplantation: 2003 International Consensus Guidelines. Transplantation 2003, 75, SS3–SS24. [Google Scholar] [CrossRef]
- Ushio, J.; Kanno, A.; Ikeda, E.; Ando, K.; Nagai, H.; Miwata, T.; Kawasaki, Y.; Tada, Y.; Yokoyama, K.; Numao, N.; et al. Pancreatic ductal adenocarcinoma: Epidemiology and risk factors. Diagnostics 2021, 11, 562. [Google Scholar] [CrossRef]
- Hur, C.; Tramontano, A.C.; Dowling, E.C.; Brooks, G.A.; Jeon, A.; Brugge, W.R.; Gazelle, G.S.; Kong, C.Y.; Pandharipande, P.V. Early pancreatic ductal adenocarcinoma survival is dependent on size. Pancreas 2016, 45, 1062–1066. [Google Scholar] [CrossRef] [PubMed]
- Egawa, S.; Toma, H.; Ohigashi, H.; Okusaka, T.; Nakao, A.; Hatori, T.; Maguchi, H.; Yanagisawa, A.; Tanaka, M. Japan pancreatic cancer registry: 30th Year Anniversary. Pancreas 2012, 41, 985–992. [Google Scholar] [CrossRef]
- Pereira, S.P.; Oldfield, L.; Ney, A.; Hart, P.A.; Keane, M.G.; Pandol, S.J.; Li, D.; Greenhalf, W.; Jeon, C.Y.; Koay, E.J.; et al. Early detection of pancreatic cancer. Lancet Gastroenterol. Hepatol. 2020, 5, 698–710. [Google Scholar] [CrossRef]
- Pelaez-Luna, M.; Takahashi, N.; Fletcher, J.G.; Chari, S.T. Resectability of presymptomatic pancreatic cancer and its relationship to onset of diabetes: A retrospective review of CT scans and fasting glucose values prior to diagnosis. Am. J. Gastroenterol. 2007, 102, 2157–2163. [Google Scholar] [CrossRef]
- Canto, M.I.; Hruban, R.H.; Fishman, E.K.; Kamel, I.R.; Schulick, R.; Zhang, Z.; Topazian, M.; Takahashi, N.; Fletcher, J.; Petersen, G.; et al. Frequent detection of pancreatic lesions in asymptomatic high-risk individuals. Gastroenterology 2012, 142, 796–804. [Google Scholar] [CrossRef] [Green Version]
- Liu, F.; **e, L.; **a, Y.; Fishman, E.; Yuille, A. Joint Shape Representation and Classification for Detecting PDAC. In Lecture Notes in Computer Science; (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); ProQuest LLC: Ann Arbor, MI, USA, 2019; Volume 11861, pp. 212–220. ISBN 9783030326913. [Google Scholar]
- Kanno, A.; Masamune, A.; Hanada, K.; Maguchi, H.; Shimizu, Y.; Ueki, T.; Hasebe, O.; Ohtsuka, T.; Nakamura, M.; Takenaka, M.; et al. Multicenter study of early pancreatic cancer in Japan. Pancreatology 2018, 18, 61–67. [Google Scholar] [CrossRef]
- Tonozuka, R.; Itoi, T.; Nagata, N.; Kojima, H.; Sofuni, A.; Tsuchiya, T.; Ishii, K.; Tanaka, R.; Nagakawa, Y.; Mukai, S. Deep learning analysis for the detection of pancreatic cancer on endosonographic images: A pilot study. J. Hepatobiliary Pancreat. Sci. 2021, 28, 95–104. [Google Scholar] [CrossRef] [PubMed]
- Tonozuka, R.; Mukai, S.; Itoi, T. The role of artificial intelligence in endoscopic ultrasound for pancreatic disorders. Diagnostics 2020, 11, 18. [Google Scholar] [CrossRef]
- Hsieh, M.H.; Sun, L.-M.; Lin, C.-L.; Hsieh, M.-J.; Hsu, C.-Y.; Kao, C.-H. Development of a prediction model for pancreatic cancer in patients with type 2 diabetes using logistic regression and artificial neural network models. Cancer Manag. Res. 2018, 10, 6317–6324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rau, H.-H.; Hsu, C.-Y.; Lin, Y.-A.; Atique, S.; Fuad, A.; Wei, L.-M.; Hsu, M.-H. Development of a web-based liver cancer prediction model for type II diabetes patients by using an artificial neural network. Comput. Methods Programs Biomed. 2016, 125, 58–65. [Google Scholar] [CrossRef]
- Matthaei, H.; Schulick, R.D.; Hruban, R.H.; Maitra, A. Cystic precursors to invasive pancreatic cancer. Nat. Rev. Gastroenterol. Hepatol. 2011, 8, 141–150. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kuwahara, T.; Hara, K.; Mizuno, N.; Okuno, N.; Matsumoto, S.; Obata, M.; Kurita, Y.; Koda, H.; Toriyama, K.; Onishi, S.; et al. Usefulness of deep learning analysis for the diagnosis of malignancy in intraductal papillary mucinous neoplasms of the pancreas. Clin. Transl. Gastroenterol. 2019, 10, e00045. [Google Scholar] [CrossRef]
- Dalal, V.; Carmicheal, J.; Dhaliwal, A.; Jain, M.; Kaur, S.; Batra, S.K. Radiomics in stratification of pancreatic cystic lesions: Machine learning in action. Cancer Lett. 2020, 469, 228–237. [Google Scholar] [CrossRef]
- Marya, N.B.; Powers, P.D.; Chari, S.T.; Gleeson, F.C.; Leggett, C.L.; Abu Dayyeh, B.K.; Chandrasekhara, V.; Iyer, P.G.; Majumder, S.; Pearson, R.K.; et al. Utilisation of artificial intelligence for the development of an EUS-convolutional neural network model trained to enhance the diagnosis of autoimmune pancreatitis. Gut 2020, 70, 1335–1344. [Google Scholar] [CrossRef]
- Nagendran, M.; Chen, Y.; Lovejoy, C.A.; Gordon, A.C.; Komorowski, M.; Harvey, H.; Topol, E.J.; Ioannidis, J.P.A.; Collins, G.S.; Maruthappu, M. Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies. BMJ 2020, 368, m689. [Google Scholar] [CrossRef] [Green Version]
- Ruffle, J.K.; Farmer, A.D.; Aziz, Q. Artificial intelligence-assisted gastroenterology—Promises and pitfalls. Am. J. Gastroenterol. 2019, 114, 422–428. [Google Scholar] [CrossRef] [PubMed]
- Epstein, D.; Cordeiro, F.; Bales, E.; Fogarty, J.; Munson, S. Taming data complexity in lifelogs. In Proceedings of the Conference on Designing Interactive Systems, Vancouver, BC, Canada, 21–25 June 2014; ACM: New York, NY, USA, 2014; pp. 667–676. [Google Scholar]
- Klare, P.; Sander, C.; Prinzen, M.; Haller, B.; Nowack, S.; Abdelhafez, M.; Poszler, A.; Brown, H.; Wilhelm, D.; Schmid, R.M.; et al. Automated polyp detection in the colorectum: A prospective study (with videos). Gastrointest. Endosc. 2019, 89, 576–582.e1. [Google Scholar] [CrossRef] [PubMed]
- Mori, Y.; Kudo, S.; Misawa, M.; Saito, Y.; Ikematsu, H.; Hotta, K.; Ohtsuka, K.; Urushibara, F.; Kataoka, S.; Ogawa, Y.; et al. Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy. Ann. Intern. Med. 2018, 169, 357. [Google Scholar] [CrossRef] [PubMed]
Modality | Device Name | Institution | Memo |
---|---|---|---|
Endoscopy | EndoBRAIN-EYE | Olympus | Colon tumor detection; made for endocytoscope |
EndoBRAIN | Olympus | Colon tumor diagnosis; made for endocytoscope | |
EndoBRAIN-Plus | Olympus | Tumor depth diagnosis; made for endocytoscope | |
EndoBRAIN-UC | Olympus | UC activity diagnosis; made for endocytoscope | |
CAD EYE | Fujifilm | Colon polyp detection and diagnosis | |
WISE VISION | NEC | Colon tumor detection Connectable to 3 major endoscope manufactures | |
WavSTAT4 | PENTAX 1 | Colorectal cancer diagnosis | |
GI Genius | Medtronic | Colorectal cancer diagnosis | |
Discovery | PENTAX 1 | AI-assisted colon polyp detector | |
CT | Liver AI | Arterys | Liver lesion detection |
US | Poseidon Ultrasound | BUTTERFLY NETWORK | Liver lesion detection |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Oka, A.; Ishimura, N.; Ishihara, S. A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology. Diagnostics 2021, 11, 1719. https://doi.org/10.3390/diagnostics11091719
Oka A, Ishimura N, Ishihara S. A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology. Diagnostics. 2021; 11(9):1719. https://doi.org/10.3390/diagnostics11091719
Chicago/Turabian StyleOka, Akihiko, Norihisa Ishimura, and Shunji Ishihara. 2021. "A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology" Diagnostics 11, no. 9: 1719. https://doi.org/10.3390/diagnostics11091719