Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning

Highlights

• An artificial intelligence system using transfer learning techniques was developed

• It effectively classified images for macular degeneration and diabetic retinopathy

• It also accurately distinguished bacterial and viral pneumonia on chest X-rays

• This has potential for generalized high-impact application in biomedical imaging

Summary

The implementation of clinical-decision support algorithms for medical imaging faces challenges with reliability and interpretability. Here, we establish a diagnostic tool based on a deep-learning framework for the screening of patients with common treatable blinding retinal diseases. Our framework utilizes transfer learning, which trains a neural network with a fraction of the data of conventional approaches. Applying this approach to a dataset of optical coherence tomography images, we demonstrate performance comparable to that of human experts in classifying age-related macular degeneration and diabetic macular edema. We also provide a more transparent and interpretable diagnosis by highlighting the regions recognized by the neural network. We further demonstrate the general applicability of our AI system for diagnosis of pediatric pneumonia using chest X-ray images. This tool may ultimately aid in expediting the diagnosis and referral of these treatable conditions, thereby facilitating earlier treatment, resulting in improved clinical outcomes.

Video Abstract

Download : Download video (30MB)