Toward Content Based Image Retrieval with Deep Convolutional Neural Networks

By Judah E. S. Sklan, Andrew J. Plassard, Daniel Fabbri, Bennett A. Landman. 2015

49 citations recorded by the source corpus.

Content-based image retrieval (CBIR) offers the potential to identify similar case histories, understand rare disorders, and eventually, improve patient care. Recent advances in database capacity, algorithm efficiency, and deep Convolutional Neural Networks (dCNN), a machine learning technique, have enabled great CBIR success for general photographic images. Here, we investigate applying the leading ImageNet CBIR technique to clinically acquired medical images captured by the Vanderbilt Medical Center. Briefly, we (1) constructed a dCNN with four hidden layers, reducing dimensionality of an input scaled to 128x128 to an output encoded layer of 4x384, (2) trained the network using back-propagation 1 million random magnetic resonance (MR) and computed tomography (CT) images, (3) labeled an independent set of 2100 images, and (4) evaluated classifiers on the projection of the labeled images into manifold space. Quantitative results were disappointing (averaging a true positive rate of only 20%); however, the data suggest that improvements would be possible with more evenly distributed sampling across labels and potential re-grouping of label structures. This preliminary effort at automated classification of medical images with ImageNet is promising, but shows that more work is needed beyond direct adaptation of existing techniques.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Oncology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Arvid Lundervold
  2. Jae-Hong Lee
  3. Do-Hyung Kim
  4. Seong-Ho Choi
  5. Seong-Nyum Jeong

In Computer Vision and Pattern Recognition

  1. Arvid Lundervold
  2. Jae-Hong Lee
  3. Do-Hyung Kim
  4. Seong-Ho Choi
  5. Seong-Nyum Jeong

In Oncology

  1. Arvid Lundervold

Citations in the corpus