research-refine-pipeline
Run an end-to-end workflow that chains `research-refine` and `experiment-plan`
Install / Use
npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill research-refine-pipelineInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
AutomationSupported Platforms
Our assessment of research-refine-pipeline
research-refine-pipeline scores 92/100 on our quality scale, 449th of 1,411 Automation skills we index (top 32%).
Its SKILL.md is 6.1 KB long, well organised into 21 sections with 3 code examples: a thorough specification that gives an agent plenty to work with.
With 16,644 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated 7 days ago, so research-refine-pipeline is actively maintained.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands.
Automated pattern scan on 2026-09-26. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
research-refine-pipeline compared with similar skills
All 4 of these similar skills score higher than research-refine-pipeline; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| research-refine-pipeline (this skill)by wanshuiyin | 92 | 16.6k | 7d ago | SKILL.md |
| Agent-Reachby Panniantong | 100 | 85.5k | 11d ago | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 73.8k | today | CLAUDE.md |
| rufloby ruvnet | 100 | 73.3k | 1d ago | CLAUDE.md |
| CowAgentby zhayujie | 100 | 47.1k | today | CLAUDE.md |
Frequently asked questions
- How do I install research-refine-pipeline?
- Run
npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill research-refine-pipeline. The install tabs above show the steps for each supported agent. - Which AI agents does research-refine-pipeline work with?
- It is written for OpenAI Codex, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is research-refine-pipeline safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is research-refine-pipeline still maintained?
- The repository was last updated 7 days ago, so research-refine-pipeline is actively maintained.
Skill content
View source on GitHubname: research-refine-pipeline
description: 'Run an end-to-end workflow that chains research-refine and experiment-plan. Use when the user wants a one-shot pipeline from vague research direction to focused final proposal plus detailed experiment roadmap, or asks to "串起来", build a pipeline, do it end-to-end, or generate both the method and experiment plan together.'
allowed-tools: Bash(*), Read, Write, Edit, Grep, Glob, WebSearch, WebFetch, mcp__codex__codex, mcp__codex__codex-reply
Research Refine Pipeline: End-to-End Method and Experiment Planning
Refine and concretize: $ARGUMENTS
Overview
Use this skill when the user does not want to stop at a refined method. The goal is to produce a coherent package that includes:
- a problem-anchored, elegant final proposal
- the review history explaining why the method is focused
- a detailed experiment roadmap tied to the paper's claims
- a compact pipeline summary that says what to run next
This skill composes two existing workflows:
research-refinefor method refinementexperiment-planfor claim-driven validation planning
For stage-specific detail, read these sibling skills only when needed:
../research-refine/SKILL.md../experiment-plan/SKILL.md
Core Rule
Do not plan a large experiment suite on top of an unstable method. First stabilize the thesis. Then turn the stable thesis into experiments.
Default Outputs
refine-logs/FINAL_PROPOSAL.mdrefine-logs/REVIEW_SUMMARY.mdrefine-logs/REFINEMENT_REPORT.mdrefine-logs/EXPERIMENT_PLAN.mdrefine-logs/EXPERIMENT_TRACKER.mdrefine-logs/PIPELINE_SUMMARY.md
Workflow
Phase 0: Triage the Starting Point
- Extract the problem, rough approach, constraints, resources, and target venue.
- Check whether
refine-logs/FINAL_PROPOSAL.mdalready exists and still matches the current request. - If the proposal is missing, stale, or materially different from the current request, run the full
research-refinestage. - If the proposal is already strong and aligned, reuse it and jump to experiment planning.
- If in doubt, prefer re-running
research-refinerather than planning experiments for the wrong method.
Phase 1: Method Refinement Stage
Run the research-refine workflow and keep its V3 philosophy intact:
- preserve the Problem Anchor
- prefer the smallest adequate mechanism
- keep one dominant contribution
- modernize only when it improves the paper
Exit this stage only when these are explicit:
- the final method thesis
- the dominant contribution
- the complexity intentionally rejected
- the key claims and must-run ablations
- the remaining risks, if any
If the verdict is still REVISE, continue into experiment planning only if the remaining weaknesses are clearly documented.
Phase 2: Planning Gate
Before the experiment stage, write a short gate check:
- What is the final method thesis?
- What is the dominant contribution?
- What complexity was intentionally rejected?
- Which reviewer concerns still matter for validation?
- Is a frontier primitive central, optional, or absent?
If these answers are not crisp, tighten the final proposal first.
Phase 3: Experiment Planning Stage
Run the experiment-plan workflow grounded in:
refine-logs/FINAL_PROPOSAL.mdrefine-logs/REVIEW_SUMMARY.mdrefine-logs/REFINEMENT_REPORT.md
Ensure the experiment plan covers:
- the main anchor result
- novelty isolation
- a simplicity or deletion check
- a frontier necessity check if applicable
- run order, budget, and decision gates
Phase 4: Integration Summary
Write refine-logs/PIPELINE_SUMMARY.md:
# Pipeline Summary
**Problem**: [problem]
**Final Method Thesis**: [one sentence]
**Final Verdict**: [READY / REVISE / RETHINK]
**Date**: [today]
## Final Deliverables
- Proposal: `refine-logs/FINAL_PROPOSAL.md`
- Review summary: `refine-logs/REVIEW_SUMMARY.md`
- Experiment plan: `refine-logs/EXPERIMENT_PLAN.md`
- Experiment tracker: `refine-logs/EXPERIMENT_TRACKER.md`
## Contribution Snapshot
- Dominant contribution:
- Optional supporting contribution:
- Explicitly rejected complexity:
## Must-Prove Claims
- [Claim 1]
- [Claim 2]
## First Runs to Launch
1. [Run]
2. [Run]
3. [Run]
## Main Risks
- [Risk]:
- [Mitigation]:
## Next Action
- Proceed to `/run-experiment`
Phase 5: Present a Brief Summary to the User
Pipeline complete.
Method output:
- refine-logs/FINAL_PROPOSAL.md
Experiment output:
- refine-logs/EXPERIMENT_PLAN.md
- refine-logs/EXPERIMENT_TRACKER.md
Pipeline summary:
- refine-logs/PIPELINE_SUMMARY.md
Best next step:
- /run-experiment
Output Protocols
Follow these shared protocols for all output files:
- Output Versioning Protocol — write timestamped file first, then copy to fixed name
- Output Manifest Protocol — log every output to MANIFEST.md
- Output Language Protocol — respect the project's language setting
Key Rules
-
Large file handling: If the Write tool fails due to file size, immediately retry using Bash (
cat << 'EOF' > file) to write in chunks. Do NOT ask the user for permission — just do it silently. -
Do not let the experiment plan override the Problem Anchor.
-
Do not widen the paper story after method refinement unless a missing validation block is truly necessary.
-
Reuse the same claims across
FINAL_PROPOSAL.md,EXPERIMENT_PLAN.md, andPIPELINE_SUMMARY.md. -
Keep the main paper story compact.
-
If the method is intentionally simple, defend that simplicity in the experiment plan rather than adding new components.
-
If the method uses a modern LLM / VLM / Diffusion / RL primitive, make its necessity test explicit.
-
If the method does not need a frontier primitive, say that clearly and avoid forcing one.
-
Prefer the staged skills when the user only needs one stage; use this skill for the integrated flow.
Composing with Other Skills
/research-refine-pipeline -> one-shot method + experiment planning
/research-refine -> method refinement only
/experiment-plan -> experiment planning only
/run-experiment -> execution
Related Skills
Agent-Reach
85.5kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
headroom
73.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
ruflo
73.3k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
CowAgent
47.1kOpen-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
