Deep feature analysis, classification with AI-driven gastrointestinal diagnostics

¹ Department of CSE, Bharatiya Engineering Science & Technology Innovation University, Anantapur, Andhra Pradesh.
¹ Department of Computer Science and Engineering, CMR Technical Campus, kandlakoya, Medchal, TS.
¹ Department of CSE, KG Reddy College of Engineering & Technology, Hyderabad, Telangana, India

^* Corresponding author: haribommala@gmail.com

Abstract

Several AI-based methods have substantially progressed the area of medical image and video-based diagnostics, which encompasses radiography, pathology, endoscopy, and the categorization of gastrointestinal (GI) diseases. When it comes to classifying numerous GI disorders, the majority of prior research that relies solely on spatial cues performs poorly. While some prior research has made use of temporal features trained on a 3D convolution neural network, these studies have focused on a very small subset of the gastrointestinal system and have used very few classes. To address these concerns, we introduce an all-inclusive AI-based system for classifying different GI illnesses using endoscopic recordings. This system can extract spatial and temporal data concurrently, leading to improved classification performance. For temporal variables, we employ a long short-term memory model; for spatial features, we employ two independent residual networks in cascade mode.