fastp-fastq-preprocessing
All-in-one FASTQ QC and adapter trimming. Auto-detects Illumina adapters, filters low-quality reads, corrects paired-end overlaps, emits HTML+JSON QC in one pass. 3-10x faster than Trim Galore/Trimmomatic. First step before STAR, BWA-MEM2, or Salmon.
Install / Use
npx skills add jaechang-hits/SciAgent-Skills --skill fastp-fastq-preprocessingInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
AutomationSupported Platforms
Tags
Our assessment of fastp-fastq-preprocessing
fastp-fastq-preprocessing scores 91/100 on our quality scale, 1098th of 2,771 Automation skills we index (top 40%).
Its SKILL.md is 16 KB long, well organised into 41 sections with 11 code examples: a thorough specification that gives an agent plenty to work with.
It has 367 GitHub stars, a meaningful sign that others use it.
Maintenance, license and trust
- The repository was last updated about 3 months ago, so fastp-fastq-preprocessing is actively maintained.
- Our last check on 2026-11-20 found the source still online.
- No license is declared. By default that means all rights are reserved: you can read it, but reusing or redistributing it is not clearly permitted. Ask the author before building on it commercially.
- Its trust signals score 88/100, with 1 caution from licensing, adoption, age or documentation. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-10-05. Automated pattern scan on 2026-10-05. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
fastp-fastq-preprocessing compared with similar skills
All 4 of these similar skills score higher than fastp-fastq-preprocessing; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| fastp-fastq-preprocessing (this skill)by jaechang-hits | 91 | 367 | 3mo ago | SKILL.md |
| Agent-Reachby Panniantong | 100 | 113.3k | 12d ago | CLAUDE.md |
| rufloby ruvnet | 100 | 82.1k | today | CLAUDE.md |
| Claude-Code-Game-Studiosby Donchitos | 100 | 40.2k | 10d ago | CLAUDE.md |
| Scraplingby D4Vinci | 100 | 104.4k | 2d ago | MCP Server |
Frequently asked questions
- How do I install fastp-fastq-preprocessing?
- Run
npx skills add jaechang-hits/SciAgent-Skills --skill fastp-fastq-preprocessing. The install tabs above show the steps for each supported agent. - Which AI agents does fastp-fastq-preprocessing work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is fastp-fastq-preprocessing safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It declares no license and scores 88/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is fastp-fastq-preprocessing still maintained?
- The repository was last updated about 3 months ago, so fastp-fastq-preprocessing is actively maintained.
Skill content
View source on GitHubname: "fastp-fastq-preprocessing" description: "All-in-one FASTQ QC and adapter trimming. Auto-detects Illumina adapters, filters low-quality reads, corrects paired-end overlaps, emits HTML+JSON QC in one pass. 3-10x faster than Trim Galore/Trimmomatic. First step before STAR, BWA-MEM2, or Salmon." license: "MIT"
fastp — Fast FASTQ Quality Control and Adapter Trimming
Overview
fastp performs adapter trimming, quality filtering, and QC reporting for Illumina FASTQ files in a single multi-threaded pass. It automatically detects adapter sequences from paired-end read overlaps — eliminating the need to specify adapters manually. fastp corrects mismatches in paired-end overlap regions, filters reads by quality score and length, removes polyX tails (polyA for RNA-seq), and generates interactive HTML and machine-readable JSON QC reports. Being 3–10× faster than Trim Galore and Trimmomatic while providing comparable or better results, fastp has become the standard preprocessing step before alignment in WGS, RNA-seq, and ChIP-seq pipelines.
When to Use
- Trimming Illumina adapters and low-quality bases before alignment in any NGS pipeline (RNA-seq, WGS, WES, ChIP-seq, ATAC-seq)
- Generating per-sample QC reports (HTML + JSON) as the first step of a pipeline, before MultiQC aggregation
- Processing paired-end reads where adapter auto-detection from overlap is preferred over manual adapter specification
- Removing polyA tails from RNA-seq reads from 3′ end-enriched protocols (Smart-seq, QuantSeq)
- Splitting a FASTQ file by UMI or by index for demultiplexing workflows
- Use Trim Galore as an alternative when TrimGalore's detailed per-base quality report from FastQC is required alongside trimming
- Use Trimmomatic as an alternative for fine-grained control of sliding-window trimming steps
Prerequisites
- Software: fastp (conda or pre-compiled binary)
- Input: raw Illumina FASTQ files (single-end or paired-end, .fastq or .fastq.gz)
Check before installing: The tool may already be available in the current environment (e.g., inside a
pixi/condaenv). Runcommand -v fastpfirst and skip the install commands below if it returns a path. When running inside a pixi project, invoke the tool viapixi run fastprather than barefastp.
# Install with conda
conda install -c bioconda fastp
# Or download pre-compiled binary (Linux)
wget https://github.com/OpenGene/fastp/releases/download/v0.24.0/fastp
chmod +x fastp
./fastp --version
# fastp 0.24.0
# Verify
fastp --version
Pre-flight Interview
Settle these with the user before writing any analysis code.
decisions:
- id: D1
param: -i / -I
kind: required
source: data
ask: "Were these reads sequenced from single-end or paired-ends of each fragment?"
default: "read off the file inventory - paired when R1/R2 mates are present"
- id: D2
param: library_prep
kind: required
source: user
ask: "Which library prep produced these reads - 5'-, 3'-, small RNA, lnRNA or amplicon?"
default: null
- id: D3
param: --trim_poly_x
kind: optional
source: user
depends_on: [D2]
ask: "Trim polyA/polyT tails left by the capture step?"
default: "on for 3'-enriched RNA-seq, off otherwise"
- id: D4
param: --adapter_sequence / --detect_adapter_for_pe
kind: required
source: user
depends_on: [D1]
ask: "Auto-detect the adapter, or supply the kit's sequence explicitly?"
default: "auto-detect"
- id: D5
param: --length_required
kind: required
source: user
depends_on: [D2]
ask: "Reads shorter than this after trimming are discarded - how short is too short to map?"
default: "15 (raise to ~36 for standard RNA-seq; keep low for small RNA)"
- id: D6
param: --qualified_quality_phred
kind: optional
source: user
ask: "How confident must a base call be before it counts as good quality?"
default: "15 (20 = 1% error)"
- id: D7
param: --correction
kind: optional
source: user
depends_on: [D1]
ask: "Correct mismatched bases where the two mates overlap?"
default: "off"
skip_if: "single-end input - there is no overlap to compare"
- id: D8
param: --low_complexity_filter
kind: optional_conditional
source: data
ask: "Drop low-complexity reads (homopolymer and short-repeat runs)?"
default: "off"
- id: D9
param: --thread, --split
kind: never_ask
source: data
reason: "Parallelism and output sharding; affect runtime and file layout, not the reads kept"
default: "8 threads, no split"
D2 is asked outright rather than guessed, because the prep drives two later answers: it decides whether polyA trimming is correct (D3, a 3'-enriched library ends in a capture tail that is not biological sequence) and where the length floor belongs (D5 — a 36 bp minimum that is right for RNA-seq discards the entire read in a small-RNA run). D4 and D7 hang on D1 because both describe what to do with a mate pair.
Quick Start
# Paired-end adapter trimming with QC report
fastp \
-i sample_R1.fastq.gz \
-I sample_R2.fastq.gz \
-o sample_R1.trimmed.fastq.gz \
-O sample_R2.trimmed.fastq.gz \
-h sample_qc.html \
-j sample_qc.json \
--thread 8
echo "Trimmed reads in: sample_R1.trimmed.fastq.gz"
Workflow
Step 1: Single-End Adapter Trimming
Run fastp on single-end FASTQ with automatic adapter detection.
# Single-end with auto adapter detection
fastp \
-i sample.fastq.gz \
-o sample.trimmed.fastq.gz \
-h sample_qc.html \
-j sample_qc.json \
--thread 8 \
--qualified_quality_phred 20 \
--length_required 36
echo "Input reads: $(zcat sample.fastq.gz | wc -l | awk '{print $1/4}')"
echo "Output reads: $(zcat sample.trimmed.fastq.gz | wc -l | awk '{print $1/4}')"
Step 2: Paired-End Adapter Trimming
Process paired-end FASTQ files with overlap-based adapter detection and correction.
# Paired-end with overlap-based adapter auto-detection
fastp \
-i sample_R1.fastq.gz \
-I sample_R2.fastq.gz \
-o sample_R1.trimmed.fastq.gz \
-O sample_R2.trimmed.fastq.gz \
-h sample_qc.html \
-j sample_qc.json \
--thread 8 \
--correction \
--detect_adapter_for_pe \
--qualified_quality_phred 20 \
--length_required 36
# Specify adapters explicitly (if auto-detection fails)
# fastp -i R1.fq.gz -I R2.fq.gz \
# --adapter_sequence AGATCGGAAGAGCACACGTCTGAACTCCAGTCA \
# --adapter_sequence_r2 AGATCGGAAGAGCGTCGTGTAGGGAAAGAGTGT \
# -o R1.out.fq.gz -O R2.out.fq.gz
Step 3: Quality Filtering and Read Length Trimming
Configure quality and length thresholds for stricter or more lenient filtering.
# Strict quality filtering (e.g., for variant calling)
fastp \
-i sample_R1.fastq.gz \
-I sample_R2.fastq.gz \
-o sample_R1.filtered.fastq.gz \
-O sample_R2.filtered.fastq.gz \
-h sample_qc.html \
-j sample_qc.json \
--thread 8 \
--qualified_quality_phred 25 \
--unqualified_percent_limit 20 \
--length_required 50 \
--max_len1 150 \
--max_len2 150 \
--low_complexity_filter \
--complexity_threshold 30
echo "Filtering complete. Check sample_qc.html for pass/fail rates."
Step 4: RNA-seq polyA Tail Removal
Remove polyA tails from 3′-enriched RNA-seq protocols before alignment.
# Remove polyA tails (QuantSeq 3′ mRNA-seq)
fastp \
-i quantseq_R1.fastq.gz \
-o quantseq_R1.trimmed.fastq.gz \
-h quantseq_qc.html \
-j quantseq_qc.json \
--thread 8 \
--trim_poly_x \
--poly_x_min_len 10 \
--qualified_quality_phred 20 \
--length_required 25
# For Smart-seq2 paired-end with polyA
fastp \
-i smartseq_R1.fastq.gz \
-I smartseq_R2.fastq.gz \
-o smartseq_R1.trimmed.fastq.gz \
-O smartseq_R2.trimmed.fastq.gz \
--trim_poly_x --poly_x_min_len 10 \
--thread 8 \
-h smartseq_qc.html -j smartseq_qc.json
Step 5: Parse QC Report JSON for Pipeline Monitoring
Extract key QC metrics from fastp's JSON output for automated quality gates.
import json
from pathlib import Path
def parse_fastp_json(json_path: str) -> dict:
with open(json_path) as f:
data = json.load(f)
before = data["summary"]["before_filtering"]
after = data["summary"]["after_filtering"]
return {
"total_reads_in": before["total_reads"],
"total_reads_out": after["total_reads"],
"pct_passed": after["total_reads"] / before["total_reads"] * 100,
"q30_rate_before": before["q30_rate"] * 100,
"q30_rate_after": after["q30_rate"] * 100,
"mean_len_before": before["read1_mean_length"],
"mean_len_after": after["read1_mean_length"],
"adapter_trimmed": data["filtering_result"]["adapter_trimmed"],
}
metrics = parse_fastp_json("sample_qc.json")
for key, val in metrics.items():
print(f"{key:25s}: {val:.1f}" if isinstance(val, float) else f"{key:25s}: {val:,}")
# Quality gate: fail if < 70% reads pass filter
if metrics["pct_passed"] < 70:
print("WARNING: Low pass rate — check raw data quality")
Step 6: Batch Preprocessing Pipeline
Process multiple samples sequentially with per-sample QC summaries.
#!/bin/bash
# Batch paired-end preprocessing for multiple samples
SAMPLES=(ctrl_1 ctrl_2 treat_1 treat_2)
DATA="data"
OUT="trimmed"
QC="qc/fastp"
THREADS=8
mkdir -p "$OUT" "$QC"
for sample in "${SAMPLES[@]}"; do
echo "=== Processing $sample ==="
fastp \
-i "$DATA/${sample}_R1.fastq.gz" \
-I "$DATA/${sample}_R2.fastq.gz" \
-o "$OUT/${sample}_R1.fastq.gz" \
-O "$OUT/${sample}_R2.fastq.gz" \
-h "$QC/${sample}.html" \
-j "$QC/${sample}.json" \
--thread $THREADS \
--correction \
--detect_adapter_for_pe \
--qualified_quality_phred 20 \
--length_required 36 \
2>&1 | grep -E "Read[12]|Filtering|Adapter|passed"
done
# Aggregate QC metrics
python3 - << 'EOF'
import json, pandas as pd
from pathlib import Path
rows = []
for jf in sorted(Path("qc/fastp").glob("*.json")):
with open(jf) as f: data = json.load(f)
after = data["summary"]["after_filtering"]
before = data["summary"]["before_filtering"]
rows.append({
"sample": jf.stem,
"reads_in": before["total_reads"],
"reads_out": after["total_reads"],
"pct_passed": round(after["total_reads"]/before["total_reads"]*100, 1),
"q30_after": round(after["q30_rate"]*100, 1),
})
df = pd.DataFrame(rows)
print(df.to_string(index=False))
df.to_csv("fastp_summary.tsv", sep="\t", index=False)
EOF
# Run MultiQC to aggregate all fastp JSON reports
multiqc qc/fastp/ -o qc/ -n fastp_multiqc_report
Key Parameters
| Parameter | Default | Range/Options | Effect |
|-----------|---------|---------------|--------|
| -i / -I | required | file path | Input FASTQ (R1 and R2 for paired-end) |
| -o / -O | required | file path | Output trimmed FASTQ (R1 and R2) |
| -h / -j | — | file path | HTML and JSON QC report output paths |
| --thread | 3 | 1–16 | CPU threads; 8 is a good balance |
| --qualified_quality_phred | 15 | 0–40 | Minimum base quality (Phred); 20 = 1% error |
| --length_required | 15 | 1–1000 | Minimum read length after trimming; discard shorter reads |
| --correction | off | flag | Correct mismatches in PE overlap region |
| --detect_adapter_for_pe | off | flag | Enable overlap-based adapter auto-detection for PE data |
| --adapter_sequence | auto | string | Explicit R1 adapter; overrides auto-detection |
| --trim_poly_x | off | flag | Trim polyX (polyA/polyT) tails; use for 3′-enriched RNA-seq |
| --low_complexity_filter | off | flag | Filter reads with low complexity (< 30% complexity by default) |
| --split | off | integer | Split output into N files per direction (f
Truncated for display — read the full file on GitHub.
Related Skills
Agent-Reach
113.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
ruflo
82.1k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
Claude-Code-Game-Studios
40.2kTurn Claude Code into a full game dev studio — 49 AI agents, 75 workflow skills, and a complete coordination system mirroring real studio hierarchy.
Scrapling
104.4k🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
