fastp: an ultra-fast all-in-one FASTQ preprocessor
By Shifu Chen, Yanqing Zhou, Yaru Chen, Jia Gu. bioRxiv, 2018
24,059 citations recorded by the source corpus.
Motivation Quality control and preprocessing of FASTQ files are essential to providing clean data for downstream analysis. Traditionally, a different tool is used for each operation, such as quality control, adapter trimming, and quality filtering. These tools are often insufficiently fast as most are developed using high-level programming languages (e.g., Python and Java) and provide limited multi-threading support. Reading and loading data multiple times also renders preprocessing slow and I/O inefficient. Results We developed fastp as an ultra-fast FASTQ preprocessor with useful quality control and data-filtering features. It can perform quality control, adapter trimming, quality filtering, per-read quality cutting, and many other operations with a single scan of the FASTQ data. It also supports unique molecular identifier preprocessing, poly tail trimming, output splitting, and base correction for paired-end data. It can automatically detect adapters for single-end and paired-end FASTQ data. This tool is developed in C++ and has multi-threading support. Based on our evaluation, fastp is 2–5 times faster than other FASTQ preprocessing tools such as Trimmomatic or Cutadapt despite performing far more operations than similar tools. Availability and Implementation The open-source code and corresponding instructions are available at https://github.com/OpenGene/fastp Contact chen@haplox.com
Subfields: Artificial Intelligence, Computer Networks and Communications, Hardware and Architecture
View Paper: https://www.semanticscholar.org/paper/0fa56e9ad5cc3da874ce5d1d9a1e868f6528db1b
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
Citations in the corpus
- Ultrafast one‐pass FASTQ data preprocessing, quality control, and deduplication using fastp (2023, background): “Fastp [7], which is an ultrafast all ‐ in ‐ one FASTQ data preprocessor with many modern features, was developed to solve these problems.”
- Using clusterProfiler to characterize multiomics data (2024, neutral): “The software typically used for this step includes FastQC, Trimmomatic 77 , or fastp 73 .”
- Advances and Challenges in Metatranscriptomic Analysis (2019, background): “org FaQCs (Lo and Chain, 2014), fastp (Chen et al., 2018), and Trimmomatic (Bolger et al.”
- CNSA: a data repository for archiving omics data (2020, methodology): “Moreover, quality control such as checking the correctness of the formats and statistic the data quality using fastp (16) is performed on raw sequencing data files in FASTQ format.”