Systematic evaluation of spliced alignment programs for RNA-seq data

By Pär G. Engström, Tamara Steijger, Botond Sipos, Gregory R. Grant, A. Kahles, Gunnar Rätsch, Nick Goldman, Tim J. P. Hubbard, J. Harrow, Roderic Guigó and 1 more. Nature Methods, 2013

538 citations recorded by the source corpus.

High-throughput RNA sequencing is an increasingly accessible method for studying gene structure and activity on a genome-wide scale. A critical step in RNA-seq data analysis is the alignment of partial transcript reads to a reference genome sequence. To assess the performance of current mapping software, we invited developers of RNA-seq aligners to process four large human and mouse RNA-seq data sets. In total, we compared 26 mapping protocols based on 11 programs and pipelines and found major performance differences between methods on numerous benchmarks, including alignment yield, basewise accuracy, mismatch and gap placement, exon junction discovery and suitability of alignments for transcript reconstruction. We observed concordant results on real and simulated RNA-seq data, confirming the relevance of the metrics employed. Future developments in RNA-seq alignment methods would benefit from improved placement of multimapped reads, balanced utilization of existing gene annotation and a reduced false discovery rate for splice junctions.

Subfields: Molecular Biology

View Paper: https://www.semanticscholar.org/paper/2a0aeff0c49c486f38fa42dcafce60586e94c7bb

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Molecular Biology

Citations in the corpus

Proteogenomics: concepts, applications, and computational strategies (2014, methodology): “35).”
Resetting Transcription Factor Control Circuitry toward Ground-State Pluripotency in Human (2014, unknown): “Sequencing reads were aligned to the human genome build hg19/GRCh37 with the STAR aligner (Dobin et al., 2013) using the two-pass method for splice junction detection (Engström et al., 2013).”
Specification of tissue-resident macrophages during organogenesis (2016, background): “(41) in which the reads are mapped twice.”
RNA Sequencing and Analysis (2015, unknown): “Efforts to systematically evaluate the performance of RNA-Seq aligners have been initiated by GENCODE's RNASeq Genome Annotation Assessment Project3 (RGASP3), which has found major performance difference between alignments tools on numerous benchmarks, including alignment yield, basewise accuracy, m”
HISAT: a fast spliced aligner with low memory requirements (2015, unknown): “8–11).”
Gaining comprehensive biological insight into the transcriptome by performing a broad-spectrum RNA-seq analysis (2017, background): “Several efforts have tried to compare the performance of different RNA-seq analysis tools 1 – 9 .”
Systematic Evaluation of Methods for Integration of Transcriptomic Data into Constraint-Based Models of Metabolism (2014, unknown): “Such studies can reveal differences in similar approaches and help in identifying strengths and weaknesses of particular approaches [13,14].”
Detecting circular RNAs: bioinformatic and experimental challenges (2016, methodology): “…algorithms when used in combination with simulated negative data sets that contain only linear reads, such as those provided by the RNA-seq Genome Annotation Assessment Project (RGASP) 35 , or a mixture of linear and circular isoforms, to more accurately reflect the circRNA detection task.”
Single-Cell RNA-Seq Technologies and Related Computational Data Analysis (2019, background): “Engstrom et al. systematically evaluated 26 read alignment protocols (did not include HISAT) and found that diﬀerent mapping tools exhibit distinct strengths and weakness, where some programs are with a faster mapping speed but a lower accuracy in splice junction detection (Engstrom et al., 2013).”
A survey of best practices for RNA-seq data analysis (2016, background): “Gene-finding tools such as Augustus [28] can incorporate RNA-seq data to better annotate protein-coding transcripts, but perform worse on non-coding transcripts [29].”
Tumor immune microenvironment characterization in clear cell renal cell carcinoma identifies prognostic and immunotherapeutically relevant messenger RNA signatures (2016, background): “[74] in which the reads are mapped twice.”