A case-based interpretable deep learning model for classification of mass lesions in digital mammography

By Alina Jade Barnett, Fides Regina Schwartz, Chaofan Tao, Yinhao Ren, Joseph Y. Lo, Cynthia Rudin. 2021

193 citations recorded by the source corpus.

Interpretability in machine learning models is important in high-stakes decisions such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks: datasets are small, confounding information is present and it can be difficult even for a radiologist to decide between watchful waiting and biopsy based on a mammogram alone. In this work we present a framework for interpretable machine learning-based mammography. In addition to predicting whether a lesion is malignant or benign, our work aims to follow the reasoning processes of radiologists in detecting clinically relevant semantic features of each image, such as the characteristics of the mass margins. The framework includes a novel interpretable neural network algorithm that uses case-based reasoning for mammography. Our algorithm can incorporate a combination of data with whole image labelling and data with pixel-wise annotations, leading to better accuracy and interpretability even with a small number of images. Our interpretable models are able to highlight the classification-relevant parts of the image, whereas other methods highlight healthy tissue and confounding information. Our models are decision aids—rather than decision makers—and aim for better overall human–machine collaboration. We do not observe a loss in mass margin classification accuracy over a black box neural network trained on the same data. The black-box nature of neural networks is a concern for high-stakes medical applications in which decisions must be based on medically relevant features. The authors develop an interpretable machine learning-based framework that aims to follow the reasoning processes of radiologists in providing predictions for cancer diagnosis in mammography.

Subfields: Artificial Intelligence, Medical Imaging

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

Citations in the corpus

Ethical Implementation of Artificial Intelligence to Select Embryos in In Vitro Fertilization (2021, methodology): “Case-based reasoning models have been developed for different problems in radiology using interpretable ML [60, 61], and thus such methods would be poised for use in embryology.”
Post-hoc Concept Bottleneck Models (2022, background): “Barnett et al. (2021) learns prototypes and uses them as concepts, where the distance to prototypes determines the model prediction.”