Deep learning for cellular image analysis
By Erick Moen, D. Bannon, Takamasa Kudo, William Graf, Markus W. Covert, David Van Valen. 2019
1,071 citations recorded by the source corpus.
Recent advances in computer vision and machine learning underpin a collection of algorithms with an impressive ability to decipher the content of images. These deep learning algorithms are being applied to biological images and are transforming the analysis and interpretation of imaging data. These advances are positioned to render difficult analyses routine and to enable researchers to carry out new, previously impossible experiments. Here we review the intersection between deep learning and cellular image analysis and provide an overview of both the mathematical mechanics and the programming frameworks of deep learning that are pertinent to life scientists. We survey the field’s progress in four key applications: image classification, image segmentation, object tracking, and augmented microscopy. Last, we relay our labs’ experience with three key aspects of implementing deep learning in the laboratory: annotating training data, selecting and training a range of neural network architectures, and deploying solutions. We also highlight existing datasets and implementations for each surveyed application. A Review on applications of deep machine learning in image analysis that offers practical guidance for biologists.
Subfields: Artificial Intelligence, Biophysics, Media Technology, Medical Imaging, Computational Biology & Bioinformatics
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Ahad Nasab
- Heinz Koeppl
- Florian Jug
- Christoph Reich
- Nafiseh Ghaffar Nia
- Alexander Krull
- Tim-Oliver Buchholz
- Loic A. Royer
In Biophysics
- Florian Jug
- Alexander Krull
- Tim-Oliver Buchholz
- Ahad Nasab
- Heinz Koeppl
- Christoph Reich
- Ying Ma
- Nafiseh Ghaffar Nia
In Media Technology
- Florian Jug
- Alexander Krull
- Tim-Oliver Buchholz
- Heinz Koeppl
- Christoph Reich
- Loic A. Royer
- Xiang Zhou
- Tim Prangemeier
In Medical Imaging
Citations in the corpus
- Democratising deep learning for microscopy with ZeroCostDL4Mic (2021, methodology): “This is also supported by observations that models perform best on datasets very similar to the training datasets 7,25 – 27 (see Supplementary Note 1 and Supplementary Fig.”
- Attention-Based Transformers for Instance Segmentation of Cells in Microstructures (2020, background): “Robust instance segmentation facilitates tracking [9], [20], which itself can be a limiting factor with regard to the data yield of an experiment [4], [9], [19], [20].”
- TrackMate 7: integrating state-of-the-art segmentation algorithms into tracking pipelines (2022, positive): “Modern segmentation algorithms, in particular those based on machine learning (ML) and deep learning (DL) approaches, can address these challenges, because they excel at image-segmentation tasks in low-SNR and high-density images 7 .”
- Spatial components of molecular tissue biology (2022, neutral): “…evaluations of segmentation meth-ods, as well as integrating them in a processing pipeline 106–108 could help decision-making on nuclear versus cytoplasmic segmentation, different segmentation algorithms 109,110 and experimental design consideration on segmentation-auxiliary membrane stains 74 .”
- Evaluation of artificial intelligence techniques in disease diagnosis and prediction (2023, background): “Since AI can interact constructively with image data in the medical world, it is increasingly used in disease diagnosis and prediction [73].”
- Spatially Informed Cell Type Deconvolution for Spatial Transcriptomics (2022, background): “However, it remains computationally challenging to detect the accurate boundaries between cells on the smFISH image data, especially when the cell density is high 68–70 .”