Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation

By Konstantinos Kamnitsas, Christian Ledig, Virginia F. J. Newcombe, Joanna P. Simpson, Andrew D. Kane, David K. Menon, Daniel Rueckert, Ben Glocker. 2016

3,360 citations recorded by the source corpus.

HIGHLIGHTSAn efficient 11‐layers deep, multi‐scale, 3D CNN architecture.A novel training strategy that significantly boosts performance.The first employment of a 3D fully connected CRF for post‐processing.State‐of‐the‐art performance on three challenging lesion segmentation tasks.New insights into the automatically learned intermediate representations. ABSTRACT We propose a dual pathway, 11‐layers deep, three‐dimensional Convolutional Neural Network for the challenging task of brain lesion segmentation. The devised architecture is the result of an in‐depth analysis of the limitations of current networks proposed for similar applications. To overcome the computational burden of processing 3D medical scans, we have devised an efficient and effective dense training scheme which joins the processing of adjacent image patches into one pass through the network while automatically adapting to the inherent class imbalance present in the data. Further, we analyze the development of deeper, thus more discriminative 3D CNNs. In order to incorporate both local and larger contextual information, we employ a dual pathway architecture that processes the input images at multiple scales simultaneously. For post‐processing of the network's soft segmentation, we use a 3D fully connected Conditional Random Field which effectively removes false positives. Our pipeline is extensively evaluated on three challenging tasks of lesion segmentation in multi‐channel MRI patient data with traumatic brain injuries, brain tumours, and ischemic stroke. We improve on the state‐of‐the‐art for all three applications, with top ranking performance on the public benchmarks BRATS 2015 and ISLES 2015. Our method is computationally efficient, which allows its adoption in a variety of research and clinical settings. The source code of our implementation is made publicly available.

Subfields: Artificial Intelligence, Biomedical Engineering, Computer Vision and Pattern Recognition, Medical Imaging

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Luc Van Gool
  2. Sergey I. Nikolenko
  3. Mohit Bansal
  4. Yoshua Bengio
  5. Quoc V. Le
  6. Percy Liang
  7. Sergey Levine
  8. Dacheng Tao

In Biomedical Engineering

  1. Daniel Rueckert
  2. Andriy Myronenko
  3. P. Heng
  4. Adrian V. Dalca
  5. Tom Kamiel Magda Vercauteren
  6. Sébastien Ourselin
  7. Guha Balakrishnan
  8. John V. Guttag

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Jitendra Malik
  5. Xiaogang Wang
  6. Trevor Darrell
  7. Andrea Vedaldi
  8. Andrew Zisserman

In Medical Imaging

  1. Daniel Rueckert
  2. Andriy Myronenko
  3. Sergey I. Nikolenko
  4. Sébastien Ourselin
  5. Ben Glocker
  6. Konstantinos Kamnitsas
  7. Tom Kamiel Magda Vercauteren
  8. Francesco Ciompi

Citations in the corpus