A systematic performance evaluation of clustering methods for single-cell RNA-seq data

By Angelo Duò, Mark D. Robinson, Charlotte Soneson. F1000Research, 2018

331 citations recorded by the source corpus.

Subpopulation identification, usually via some form of unsupervised clustering, is a fundamental step in the analysis of many single-cell RNA-seq data sets. This has motivated the development and application of a broad range of clustering methods, based on various underlying algorithms. Here, we provide a systematic and extensible performance evaluation of 12 clustering algorithms, including both methods developed explicitly for scRNA-seq data and more general-purpose methods. The methods were evaluated using 9 publicly available scRNA-seq data sets as well as three simulations with varying degree of cluster separability. The same feature selection approaches were used for all methods, allowing us to focus on the investigation of the performance of the clustering algorithms themselves. We evaluated the ability of recovering known subpopulations, the stability and the run time of the methods. Additionally, we investigated whether the performance could be improved by generating consensus partitions from multiple individual clustering methods. We found substantial differences in the performance, run time and stability between the methods, with SC3 and Seurat showing the most favorable results. Additionally, we found that consensus clustering typically did not improve the performance compared to the best of the combined methods, but that several of the top-performing methods already perform some type of consensus clustering. The R scripts providing an extensible framework for the evaluation of new methods and data sets are available on GitHub ( https://github.com/markrobinsonuzh/scRNAseq_clustering_comparison).

Subfields: Molecular Biology

View Paper: https://www.semanticscholar.org/paper/1390a4a8fbb640f598cc042005e9c114cbe1c24e

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Molecular Biology

Citations in the corpus

A comparison of automatic cell identification methods for single-cell RNA sequencing data (2019, result): “In contrast to the extensive evaluations of clustering, differential expression, and trajectory inference methods [10–12], there is currently only a single attempt comparing methods to”
Embracing the dropouts in single-cell RNA-seq analysis (2020, methodology): “Almost all existing computational methods developed for scRNA-seq adopted gene selection and dimension reduction strategies to address the dropouts 17,18 .”
Best practices for single-cell analysis across modalities (2023, background): “Differential gene expression (DGE) analysis is currently approached from two viewpoints.”
Spatially Informed Cell Type Deconvolution for Spatial Transcriptomics (2022, background): “77, CT15 colored in blue) that was not found by other deconvolution methods.”