mcp-web-reader

让Claude等大语言模型轻松获取和解析任何网页内容，并转化为干净的Markdown。支持双引擎、批量处理，增强AI互联网信息处理能力。

Generate Convert Improve

Install / Use

claude mcp add zacfire -- npx -y github:zacfire/mcp-web-reader

If the server publishes to npm under a different name, use that package instead — check the repo README.

About this skill

🔌

MCP Server

Model Context Protocol server

Quality Score

70/100

Our assessment of mcp-web-reader

mcp-web-reader scores 70/100 on our quality scale, 1075th of 1,178 Content & Media skills we index.

Its MCP Server is 2.5 KB long, well organised into 24 sections with 5 code examples: a solid amount of guidance for an agent.

It has 48 GitHub stars, so there is little community track record yet; judge it on its content.

Substance

26/30

Structure

20/20

Description

12/15

Adoption

7/20

Freshness

5/15

Maintenance, license and trust

The repository was last updated about 16 months ago. Expect some instructions to reference tool versions or APIs that have since changed.
Our last check on 2026-09-28 found the source still online.
No license is declared. By default that means all rights are reserved: you can read it, but reusing or redistributing it is not clearly permitted. Ask the author before building on it commercially.
Its trust signals score 68/100, with 3 cautions from licensing, adoption, age or documentation. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

Safety scan

No issues found

Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.

AI review by kimi-k2.7-code on 2026-09-24. Automated pattern scan on 2026-09-24. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.

mcp-web-reader compared with similar skills

All 4 of these similar skills score higher than mcp-web-reader; compare them before choosing.

Skill	Score	Stars	Updated	Format
mcp-web-reader (this skill)by zacfire	70	48	16mo ago	MCP Server
Agent-Reachby Panniantong	100	109.7k	today	CLAUDE.md
headroomby headroomlabs-ai	100	79.0k	today	CLAUDE.md
CowAgentby zhayujie	100	47.8k	1d ago	CLAUDE.md
Scraplingby D4Vinci	100	98.8k	1d ago	MCP Server

Frequently asked questions

How do I install mcp-web-reader?: Run claude mcp add zacfire -- npx -y github:zacfire/mcp-web-reader. The install tabs above show the steps for each supported agent.
Which AI agents does mcp-web-reader work with?: It is written for Claude Code and Claude Desktop, as a MCP Server file. Other agents that read the same format can often use it too.
Is mcp-web-reader safe to use?: Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It declares no license and scores 68/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is mcp-web-reader still maintained?: The repository was last updated about 16 months ago. Expect some instructions to reference tool versions or APIs that have since changed.

Skill content

View source on GitHub

MCP Web Reader

一个强大的 MCP (Model Context Protocol) 服务器，让 Claude 和其他大语言模型能够读取和解析网页内容。支持突破访问限制，轻松获取微信文章、时代杂志等受保护内容。

功能特点

🚀 三引擎支持：集成 Jina Reader API、本地解析器和 Playwright 浏览器
🔄 智能降级：Jina Reader → 本地解析 → Playwright 浏览器三层自动切换
🌐 突破限制：使用 Playwright 处理 Cloudflare、验证码等访问限制
📦 批量处理：支持同时获取多个 URL
🎯 灵活控制：可选择强制使用特定解析方式
📝 Markdown 输出：自动转换为清晰的 Markdown 格式

安装

方法 1：从源码安装

# 克隆仓库
git clone https://github.com/zacfire/mcp-web-reader.git
cd mcp-web-reader

# 安装依赖
npm install

# 构建项目
npm run build

# 安装 Playwright 浏览器（必需）
npx playwright install chromium

方法 2：使用 npm 安装（如果已发布）

npm install -g mcp-web-reader

配置

在 Claude Desktop 的配置文件中添加：

Windows: %APPDATA%\Claude\claude_desktop_config.json

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "web-reader": {
      "command": "node",
      "args": ["/absolute/path/to/mcp-web-reader/dist/index.js"]
    }
  }
}

使用方法

配置完成后，在 Claude 中可以使用以下命令：

智能获取（推荐）
- "请获取 https://example.com 的内容"
- 自动三层降级：Jina Reader → 本地解析 → Playwright 浏览器
批量获取
- "请获取这些网页：[url1, url2, url3]"
- 每个URL都享受智能降级策略
强制使用 Jina Reader
- "使用 Jina Reader 获取 https://example.com"
强制使用本地解析
- "使用本地解析器获取 https://example.com"
强制使用浏览器模式
- "使用浏览器获取 https://example.com"
- 直接跳过其他方式，适用于确定有访问限制的网站

支持的受限网站类型

✅ 微信公众号文章 - 自动绕过访问限制
✅ 时代杂志、纽约时报 - 突破付费墙和地区限制
✅ Cloudflare 保护网站 - 通过真实浏览器绕过检测
✅ 需要 JavaScript 渲染的页面 - 完整执行页面脚本
✅ 有验证码/人机验证的网站 - 模拟真实用户行为

工具列表

fetch_url - 智能获取（三层降级：Jina → 本地 → Playwright）
fetch_url_with_jina - 强制使用 Jina Reader
fetch_url_local - 强制使用本地解析器
fetch_url_with_browser - 强制使用 Playwright 浏览器（突破访问限制）
fetch_multiple_urls - 批量获取多个 URL

技术架构

智能降级策略

用户请求 URL
    ↓
1. Jina Reader API (最快，成功率高)
    ↓ 失败
2. 本地解析器 (Node.js + JSDOM)
    ↓ 检测到访问限制
3. Playwright 浏览器 (真实浏览器，突破限制)

访问限制检测

自动识别以下情况并启用浏览器模式：

HTTP 状态码：403, 429, 503, 520-524
错误关键词：Cloudflare, CAPTCHA, Access Denied, Rate Limit
内容关键词：Security Check, Human Verification

开发

# 开发模式（自动重新编译）
npm run dev

# 构建
npm run build

# 测试运行
npm start

# 安装浏览器二进制文件（首次使用必需）
npx playwright install chromium

性能优化

⚡ 浏览器实例复用 - 避免重复启动开销
🚫 资源过滤 - 阻止图片、样式表等不必要加载
🎯 智能选择 - 优先使用快速方法，必要时才用浏览器
💾 优雅关闭 - 正确清理浏览器资源

贡献

欢迎提交 Pull Request！

许可证

MIT License

Related Skills

Agent-Reach

109.7k

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

headroom

79.0k

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

CowAgent

47.8k

Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.

Scrapling

98.8k

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

zacfire

View profile

View on GitHub

GitHub Stars48

CategoryContent

Updated1y ago

Forks11

zacfire/mcp-web-reader

Languages

TypeScript

Trust signals

68/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

2 medium1 low1 info