SkillAgentSearch skills...

academic-paper-reviewer

Multi-perspective academic paper review with dynamic reviewer personas. Simulates 5 independent reviewers (EIC + 3 peer reviewers + Devil's Advocate) with field-specific expertise. Supports full review, re-review (verification), quick assessment, methodology focus, and Socratic guided modes.

Install / Use

npx skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill academic-paper-reviewer

Installs into whichever agent you are using.

About this skill
πŸ“„

SKILL.md

Installable skill definition

Quality Score

95/100

Supported Platforms

Universal

Our assessment of academic-paper-reviewer

academic-paper-reviewer scores 95/100 on our quality scale, 47th of 319 Customer Support skills we index (top 15%).

Its SKILL.md is 21 KB long, well organised into 46 sections with 12 code examples: a thorough specification that gives an agent plenty to work with.

With 4,360 GitHub stars, it is one of the more widely adopted skills in the catalogue.

Substance
30/30
Structure
20/20
Description
15/15
Adoption
15/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated about 2 months ago, so academic-paper-reviewer is actively maintained.
  • Our last check on 2026-11-15 found the source still online.
  • No license is declared. By default that means all rights are reserved: you can read it, but reusing or redistributing it is not clearly permitted. Ask the author before building on it commercially.
  • Its trust signals score 88/100, with 1 caution from licensing, adoption, age or documentation. These come from repository metadata, not a code audit β€” read the skill file before letting an agent act on it.

Safety scan

No issues found

Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.

AI review by kimi-k2.7-code on 2026-09-29. Automated pattern scan on 2026-09-28. It catches known dangerous patterns, not every risk β€” read a skill before letting an agent act on it.

academic-paper-reviewer compared with similar skills

All 4 of these similar skills score higher than academic-paper-reviewer; compare them before choosing.

SkillScoreStarsUpdatedFormat
academic-paper-reviewer (this skill)by brycewang-stanford954.4k54d agoSKILL.md
x402by browser-use100121.0k3d agoSKILL.md
algorithmic-artby anthropics100177.9k55d agoSKILL.md
pptxby anthropics100177.9k55d agoSKILL.md
designby nextlevelbuilder100149.0k6d agoSKILL.md

Frequently asked questions

How do I install academic-paper-reviewer?
Run npx skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill academic-paper-reviewer. The install tabs above show the steps for each supported agent.
Which AI agents does academic-paper-reviewer work with?
It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
Is academic-paper-reviewer safe to use?
Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It declares no license and scores 88/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is academic-paper-reviewer still maintained?
The repository was last updated about 2 months ago, so academic-paper-reviewer is actively maintained.

name: academic-paper-reviewer description: "Multi-perspective academic paper review with dynamic reviewer personas. Simulates 5 independent reviewers (EIC + 3 peer reviewers + Devil's Advocate) with field-specific expertise. Supports full review, re-review (verification), quick assessment, methodology focus, and Socratic guided modes. Triggers on: review paper, peer review, manuscript review, referee report, review my paper, critique paper, simulate review, editorial review." metadata: version: "1.4" last_updated: "2026-03-08"

Academic Paper Reviewer v1.4 β€” Multi-Perspective Academic Paper Review Agent Team

Simulates a complete international journal peer review process: automatically identifies the paper's field, dynamically configures 5 reviewers (Editor-in-Chief + 3 peer reviewers + Devil's Advocate) who review from four non-overlapping perspectives β€” methodology, domain expertise, cross-disciplinary viewpoints, and core argument challenges β€” ultimately producing a structured Editorial Decision and Revision Roadmap.

v1.1 Improvements:

  1. Added Devil's Advocate Reviewer β€” specifically challenges core arguments, detects logical fallacies, and identifies the strongest counter-arguments
  2. Added re-review mode β€” verification review, focused on checking whether revisions address the review comments
  3. Expanded review team from 4 to 5 members

Quick Start

Simplest command:

Review this paper: [paste paper or provide file]
Review this paper: [paste paper or provide file]

Output:

  1. Automatically identifies the paper's field and methodology type
  2. Dynamically configures the specific identities and expertise of 5 reviewers
  3. 5 independent review reports (each from a different perspective)
  4. 1 Editorial Decision Letter + Revision Roadmap

Trigger Conditions

Trigger Keywords

English: review paper, peer review, manuscript review, referee report, review my paper, critique paper, simulate review, editorial review

Non-Trigger Scenarios

| Scenario | Skill to Use | |----------|-------------| | Need to write a paper (not review) | academic-paper | | Need in-depth investigation of a research topic | deep-research | | Need to revise a paper (already have review comments) | academic-paper (revision mode) |

Quick Mode Selection Guide

| Your Situation | Recommended Mode | |----------------|-----------------| | Need comprehensive review (first submission) | full | | Checking if revisions addressed comments | re-review | | Quick quality assessment (15 min) | quick | | Focus only on methods/statistics | methodology-focus | | Want to learn by doing (guided review) | guided |

Not sure? Use full for pre-submission review, re-review for post-revision verification.


Agent Team (7 Agents)

| # | Agent | Role | Phase | |---|-------|------|-------| | 1 | field_analyst_agent | Analyzes the paper's field, dynamically configures 5 reviewer identities | Phase 0 | | 2 | eic_agent | Journal Editor-in-Chief β€” journal fit, originality, overall quality | Phase 1 | | 3 | methodology_reviewer_agent | Peer Reviewer 1 β€” research design, statistical validity, reproducibility | Phase 1 | | 4 | domain_reviewer_agent | Peer Reviewer 2 β€” literature coverage, theoretical framework, domain contribution | Phase 1 | | 5 | perspective_reviewer_agent | Peer Reviewer 3 β€” cross-disciplinary connections, practical impact, challenging fundamental assumptions | Phase 1 | | 6 | devils_advocate_reviewer_agent | Devil's Advocate β€” core argument challenges, logical fallacy detection, strongest counter-arguments | Phase 1 | | 7 | editorial_synthesizer_agent | Synthesizes all reviews, identifies consensus and disagreements, makes editorial decision | Phase 2 |


Orchestration Workflow (3 Phases)

User: "Review this paper"
     |
=== Phase 0: FIELD ANALYSIS & PERSONA CONFIGURATION ===
     |
     +-> [field_analyst_agent] -> Reviewer Configuration Card (x5)
         - Reads the complete paper
         - Identifies: primary discipline, secondary discipline, research paradigm, methodology type, target journal tier, paper maturity
         - Dynamically generates specific identities for 5 reviewers:
           * EIC: Which journal's editor, area of expertise, review preferences
           * Reviewer 1 (Methodology): Methodological expertise, what they particularly focus on
           * Reviewer 2 (Domain): Domain expertise, research interests
           * Reviewer 3 (Perspective): Cross-disciplinary angle, what unique perspective they bring
           * Devil's Advocate: Specifically challenges core arguments, detects logical gaps
     |
     ** Presents Reviewer Configuration to user for confirmation (adjustable) **
     |
=== Phase 1: PARALLEL MULTI-PERSPECTIVE REVIEW ===
     |
     |-> [eic_agent] -------> EIC Review Report
     |   - Journal fit, originality, significance, relevance to readership
     |   - Does not go deep into methodology (that's Reviewer 1's job)
     |   - Sets the review tone
     |
     |-> [methodology_reviewer_agent] -> Methodology Review Report
     |   - Research design rigor, sampling strategy, data collection
     |   - Analysis method selection, statistical validity, effect sizes
     |   - Reproducibility, data transparency
     |
     |-> [domain_reviewer_agent] -------> Domain Review Report
     |   - Literature review completeness, theoretical framework appropriateness
     |   - Academic argument accuracy, incremental contribution to the field
     |   - Missing key references
     |
     |-> [perspective_reviewer_agent] --> Perspective Review Report
     |   - Cross-disciplinary connections and borrowing opportunities
     |   - Practical applications and policy implications
     |   - Broader social or ethical implications
     |
     +-> [devils_advocate_reviewer_agent] --> Devil's Advocate Report
         - Core argument challenges (strongest counter-arguments)
         - Cherry-picking detection
         - Confirmation bias detection
         - Logic chain validation
         - Overgeneralization detection
         - Alternative paths analysis
         - Stakeholder blind spots
         - "So what?" test
     |
=== Phase 2: EDITORIAL SYNTHESIS & DECISION ===
     |
     +-> [editorial_synthesizer_agent] -> Editorial Decision Package
         - Consolidates 5 reports (including Devil's Advocate challenges)
         - Identifies consensus (5 agree) vs. disagreement (divergent opinions)
         - Arbitration and argumentation for disputed issues
         - Devil's Advocate CRITICAL issues are specially flagged in the Editorial Decision
         - Editorial Decision Letter
         - Revision Roadmap (prioritized, can be directly input to academic-paper revision mode)
     |
=== Phase 2.5: REVISION COACHING (Socratic Revision Guidance) ===
     |
     ** Only triggered when Decision = Minor/Major Revision **
     |
     +-> [eic_agent] guides the user through Socratic dialogue:
         1. Overall positioning β€” "After reading the review comments, what surprised you the most?"
         2. Core issue focus β€” Guides user to understand consensus issues
         3. Revision strategy β€” "If you could only change three things, which three would you choose?"
         4. Counter-argument response β€” Guides user to think about how to respond to Devil's Advocate challenges
         5. Implementation planning β€” Helps prioritize revisions
     |
     +-> After dialogue ends, produces:
         - User's self-formulated revision strategy
         - Reprioritized Revision Roadmap
     |
     ** User can say "just fix it" to skip guidance **

Checkpoint Rules

  1. After Phase 0 completes: Present Reviewer Configuration Card to user; user can adjust reviewer identities
  2. Phase 1: 5 reviewers review independently, without cross-referencing each other
  3. Phase 2: Synthesizer cannot fabricate review comments; must be based on specific reports from Phase 1
  4. Devil's Advocate special handling: If the Devil's Advocate finds CRITICAL issues, the Editorial Decision cannot be Accept
  5. Phase 2.5: Revision Coaching only triggers when Decision is not Accept; user can choose to skip

Operational Modes (5 Modes)

| Mode | Trigger | Agents | Output | |------|---------|--------|--------| | full | Default / "full review" | All 7 agents | 5 review reports + Editorial Decision + Revision Roadmap | | re-review | Pipeline Stage 3' / "verification review" | field_analyst + eic + editorial_synthesizer | Revision response checklist + residual issues + new Decision | | quick | "quick review" | field_analyst + eic | EIC quick assessment + key issues list (15-minute version) | | methodology-focus | "check methodology" | field_analyst + methodology_reviewer | In-depth methodology review report | | guided | "guide me" | All + Socratic dialogue | Socratic issue-by-issue guided review |

Mode Selection Logic

"Review this paper"                      -> full
"Give me a quick look at this paper"     -> quick
"Help me check the methodology"          -> methodology-focus
"Does this paper have methodology issues"-> methodology-focus
"Guide me to improve this paper"         -> guided
"Walk me through the issues in my paper" -> guided
"Verification review" / "Check revisions"-> re-review

Re-Review Mode (Added in v1.1 β€” Verification Review)

Re-review mode is the dedicated mode for Pipeline Stage 3', designed to verify whether revisions address the first-round review comments.

How It Works

Input:
1. Original Revision Roadmap (Stage 3 output)
2. Revised manuscript
3. Response to Reviewers (optional)

Phase 0: Reads the Revision Roadmap, builds a checklist
Phase 1: EIC checks each item (other reviewers not activated)
Phase 2: Editorial Synthesis -> New Decision

Verification Logic

For each item in the Revision Roadmap:

Priority 1 (Required):
  -> Check each item for corresponding changes in the revised manuscript
  -> Assess revision quality (FULLY_ADDRESSED / PARTIALLY_ADDRESSED / NOT_ADDRESSED / MADE_WORSE)
  -> All Priority 1 items must be FULLY_ADDRESSED for Accept

Priority 2 (Suggested):
  -> Check each item
  -> At least 80% should have a response
  -> NOT_ADDRESSED items require author explanation

Priority 3 (Nice to Fix):
  -> Check but does not affect Decision

New Issue Detection

In addition to checking old items, EIC also scans for:
- Whether content added during revision introduces new problems
- Whether newly added references are correct (but deep verification is left to Stage 4.5 integrity check)
- Whether revisions cause inconsistencies

Socratic Guidance After Re-Review

If Re-Review Decision = Major Revision:
  -> Activate Residual Coaching (residual issue guidance)
  -> EIC guides user through Socratic dialogue:
    1. Gap analysis β€” "How many issues did the first round of revisions resolve? Why are the remaining ones hard to address?"
    2. Root cause diagnosis β€” "Is it insufficient evidence, unclear argumentation, or a structural problem?"
    3. Trade-off decisions β€” "Which ones can be marked as research limitations?"
    4. Action plan β€” Plan revision approach for each residual issue
  -> Maximum 5 rounds of dialogue
  -> User can say "just fix it" to skip guidance

Re-Review Output Format

# Verification Review Report

## Decision
[Accept / Minor Revision / Major Revision]

## Revision Response Checklist

### Priority 1 β€” Required Revisions

| # | Original Review Comment | Response Status | Revision Location | Quality Assessment |
|---|------------------------|-----------------|-------------------|-------------------|
| R1 | [Original text] | FULLY_ADDRESSED | Section X.X | Adequately addressed; newly added content effectively resolves the issue |
| R2 | [Original text] | PARTIALLY_ADDRESSED | Section Y.Y | Partially addressed, but st

Truncated for display β€” read the full file on GitHub.

Related Skills

View on GitHub
GitHub Stars4.4k
CategoryCustomer
Updated1mo ago
Forks527

Languages

Stata

Trust signals

88/100

From repository metadata: license, adoption, age and documentation. Not a code audit β€” see the Safety scan above for what the skill file itself contains.

1 medium
academic-paper-reviewer β€” Universal Skill: Install & Safety Check | SkillAgent