my-websearch
Multi-engine web search MCP server, CLI, and daemon — no API keys required. 16+ engines (Bing, Baidu, DDG, Brave, GitHub, arXiv, etc.), MDN / RFC / DevDocs / Context7 documentation, outline & JSON-LD structured article fetching.
Install / Use
claude mcp add wtznicy -- npx -y github:wtznicy/my-websearchIf the server publishes to npm under a different name, use that package instead — check the repo README.
MCP Server
Model Context Protocol server
Quality Score
Category
Content & MediaSupported Platforms
Our assessment of my-websearch
my-websearch scores 74/100 on our quality scale, 1045th of 1,153 Content & Media skills we index.
Its MCP Server is 45 KB long, well organised into 40 sections with 9 code examples: long enough that it reads more like full documentation than a focused instruction file, which agents can find harder to follow.
It has 3 GitHub stars, so there is little community track record yet; judge it on its content.
Maintenance, license and trust
- The repository was last updated 4 days ago, so my-websearch is actively maintained.
- It is released under the Apache-2.0 license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 92/100, with 1 caution from licensing, adoption, age or documentation. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-11-15. Automated pattern scan on 2026-11-15. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
my-websearch compared with similar skills
All 4 of these similar skills score higher than my-websearch; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| my-websearch (this skill)by wtznicy | 74 | 3 | 4d ago | MCP Server |
| Agent-Reachby Panniantong | 100 | 112.3k | 8d ago | CLAUDE.md |
| rufloby ruvnet | 100 | 81.9k | today | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 79.8k | today | CLAUDE.md |
| CowAgentby zhayujie | 100 | 48.0k | today | CLAUDE.md |
Frequently asked questions
- How do I install my-websearch?
- Run
claude mcp add wtznicy -- npx -y github:wtznicy/my-websearch. The install tabs above show the steps for each supported agent. - Which AI agents does my-websearch work with?
- It is written for Claude Code and Claude Desktop, as a MCP Server file. Other agents that read the same format can often use it too.
- Is my-websearch safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is Apache-2.0-licensed and scores 92/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is my-websearch still maintained?
- The repository was last updated 4 days ago, so my-websearch is actively maintained.
Skill content
View source on GitHub🔍 MyWebSearch
Keyless Multi-Engine AI Web Search & High-Purity Content Extraction Engine
MCP Server · CLI · Local HTTP Daemon · Skill-Guided Agent Workflows
One server, four ways to use it: connect an AI client over MCP, run a one-shot CLI query, keep a local daemon alive, or use the built-in diagnostics before going live.
Jump to: Quick start · MCP tools · CLI · Configuration · Diagnostics · Development
✨ Features
my-websearch is a full-stack search and technical documentation engine built specifically for AI coding agents (Claude Desktop, Cursor, Cherry Studio, Windsurf, Cline, ZCode, etc.). Out of the box, ready for multiple mainstream AI clients:
- 🌐 16-Engine Federated Search & Smart Routing
Aggregates direct domestic engines (Bing, Baidu, CSDN, Juejin, Sogou), global engines (DuckDuckGo, Brave, Startpage, Yahoo, Exa, Bing News), and specialized developer platforms (GitHub, StackOverflow, Hacker News, arXiv). Features automatic language-aware routing (auto), parallel multi-query execution (queries: string[]), URL deduplication, and automaticminResultscascading fallback. When DuckDuckGo is unhealthy, Yahoo automatically joins the English primary group from the fallback pool. - ⚡ Native Web Protocol & Proof-of-Work Solvers (Browser-Free Fast Path, Browser Fallback Only When Needed)
Built onwreq-jswith native modern TLS/HTTP2 handshake emulation and persistent session cookies. Includes pure-JS/Rust solvers for Startpage's Anubis SHA-256 PoW challenge and DuckDuckGo'sd.js(isJsaChallenge) HTML5/arithmetic challenge, so most challenges resolve without launching a browser. Request stacks are engine-specific: DuckDuckGo requires the wreq Chrome profile via GET (axios POST is challenged with HTTP 202), while Brave defaults to curl HTTP/1.1 (Windows Schannel; tested curl 7/10 before rate limiting, axios 0/10, wreq HTTP/2 429). When a Brave 429 turns out to be an anti-bot challenge page, the engine retries once through a disguised headless CDP browser that clicks the Argon2 PoW button itself (~4–6s; measured 8/8 while plain HTTP stayed 429). Note: DuckDuckGo's page-level HTTP 202 anomaly CAPTCHA ("select all squares containing a duck") is human verification and is intentionally not bypassed — it is reported asbot_challenge; Brave's challenge is computational (Argon2 PoW) and is solved by the page's own JavaScript, not by us. Real URL resolution for Sogou redirect links, BaiduLocation, and Bing Base64 links. - 📄 High-Purity Markdown Article Extraction & Dedicated Site Purifiers
Combines Mozilla Readability with intelligent chrome noise stripping. Features dedicated purification rules for WeChat Official Accounts (mp.weixin.qq.com), StackOverflow questions & accepted answers, and transparent internal routing for CSDN & Juejin. Removes<nav>,<aside>,<footer>, and breadcrumbs while faithfully preserving article titles, code blocks, and GFM tables. Supports seamless pagination (startIndex), plus three token-saving modes: BM25 relevance-rankedfocus, CSS-selectorextractto JSON with no LLM, and numberedcitations. - 📚 Unified Context7 Library Docs Lookup (
queryDocs)
Directly query official documentation with natural package names (e.g."next.js","vue") or Context7 IDs without needing a separate resolve step. Includes automatic candidate ranking, blind-guess 404 self-healing, and related alternatives discovery. - 🐙 Extended GitHub / Gitee Resource Fetcher & Whole-Repo Code Symbol Search
fetchGithubContent(formerlyfetchGithubReadme) supports both GitHub and Gitee: repository READMEs, any source file (/blob/..., withlines/#L120-L180slicing), directory trees (/tree/...), complete issue / PR discussions, commits (/commit/<sha>), compare views (/compare/a...b), and releases (/releases,/releases/tag/<tag>). Tokenless Code Symbol Search: Passsymbol: "Use"to perform fast, tokenless whole-repository syntactic code symbol search across Go, TypeScript/JavaScript, Python, Rust, Java, C#, Ruby, PHP, and Swift. Instantly locates function, class, struct, type, and macro declarations with line numbers and contextual implementation code blocks. - 🌏 Zero-Config Network Detection & Fake-IP Ready
Auto-detects OS system proxies (Windows Registry / macOS scutil / Linux env). Automatically routes overseas engines through proxy while keeping domestic engines on fast direct lines. Pre-whitelists198.18.0.0/15for TUN / Fake-IP compatibility while enforcing strict SSRF security bounds. No proxy is the supported default: outside mainland China, leavePROXY_URLunset and every engine is queried directly — you don't need Clash/v2ray to use this server. - 🔌 Versatile Deployment Modes
Works seamlessly across MCP STDIO (Claude Desktop/Cursor), Streamable HTTP / SSE (Cherry Studio/remote clients), CLI one-shot commands, and a Local HTTP Daemon with connection pool reuse and Prometheus/metricsmonitoring.
🌍 16 Search Engines
| Engine | Mainland China Connectivity | API Key | Core Technology | Best For |
| :--- | :---: | :---: | :--- | :--- |
| bing | 🇨🇳 Direct | None | Chrome TLS impersonation + Base64 real URL resolution + stealth fallback | General technical search, mixed EN/ZH queries |
| bing-news | 🌐 Proxy in CN | None | Bing News RSS + pubDate 24h filter + apiclick.aspx?url= decoding; direct can 302 to an HTML page, so it is proxy-eligible by default; opt-in vertical engine | Breaking news, last-24h updates |
| baidu | 🇨🇳 Direct | None | Concurrent Location redirect resolution + challenge detection | Chinese news, documentation, domestic forums |
| csdn | 🇨🇳 Direct | None | WAF cookie jar persistence + empty response auto-retry | Chinese error logs, debugging tutorials |
| juejin | 🇨🇳 Direct | None | Direct official API querying for clean long-form articles | Modern frontend/backend technical blogs |
| sogou | 🇨🇳 Direct | None | Desktop & mobile dual parsing + redirect link decoding + ad removal | WeChat ecosystem links & long-tail queries |
| duckduckgo | 🌐 Proxy in CN | None | wreq Chrome-profile GET of the HTML endpoint (202 anomaly CAPTCHA only on the axios fallback); d.js solver retained for the preload fallback | English technical search & open-source discussions |
| startpage | 🌐 Proxy in CN | None | Multi-worker Anubis SHA-256 PoW solver (difficulty ≤ 6) + cookie session (no browser needed) | Google-backed high-privacy results |
| yahoo | 🌐 Proxy in CN | None | SSR HTML + homepage cookie warm-up + RU= redirect decoding; English fallback pool (auto-substitutes when DuckDuckGo is unhealthy) | Stable Bing-index English fallback |
| brave | 🌐 Proxy in CN | None | curl HTTP/1.1 (Windows Schannel; tested 7/10 before 429; axios 0/10; wreq HTTP/2 429) + strict sponsored ad stripping; compatible with Windows' older curl builds (no --compressed requirement); on 429 it auto-triggers the PoW challenge through a disguised desktop headless CDP browser (~4–6s, measured 8/8 while HTTP stayed 429); if that still fails: wait / rotate IP / use BRAVE_API_KEY | Independent English index & technical blogs |
| exa | 🌐 Proxy preferred | Optional Free Key | Official semantic search API (skipped if key is unset); direct works too, but proxy measured ~0.77s vs ~1.17s direct | Semantic similarity, AI research & papers |
| github | 🌐 Direct API | None | Official GitHub Search REST API + exact owner/repo fast path (issues & repositories) | GitHub issues, bug reports, repositories, and exact repo lookup |
| stackoverflow| 🌐 Direct API | None | Official StackExchange 2.3 API with HTML entity decoding | Developer troubleshooting, stack traces & answers |
| hackernews | 🌐 Direct API | None | Algolia HN Search API with points, comments & author metadata | Tech discussions, startup launches & engineering news |
| arxiv | 🌐 Direct API | None | Official arXiv Atom XML API parsing titles, authors & abstracts | Scientific papers, machine learning & AI research |
| code | 🌐 Proxy in CN | None | grep.app API search across global GitHub code with repo, path & exact line numbers | Source code implementations, API usage patterns |
Version note: this README tracks the current source tree (1.6.0). 1.6.0 is a code intelligence and multi-source documentation release:
fetchGithubContentadds tokenless whole-repo syntactic symbol search (symbol, powered by in-memory streaming tarball unpack & two-stage sampling across Go/TS/Python/Rust and more);queryDocsoverhauled with multi-source authority (DevDocs, Javadoc, docs.rs, pkg.go.dev, MDN, Context7, and package registries with syntax-level Markdown section extraction and preamble protection); removal ofcodeSymboland heavy external dependencies, converging the MCP tool surface to 4 lean core tools (total description characters ≤1000). 1.5.1 is a search-quality release: diversity-aware early return, host cap, Chinese-tech routing to Bing/Baidu/Sogou, official-intent anchors, Baidu real-URL extraction, and aneval:qualitybenchmark. 1.5.0 unified test suites (Vitest), centralized env access, Brave 180s browser-only window, and Node.js ≥22 requirement.
<a id="mcp-tools"></a>
🛠️ 4 Core MCP Tools (Minimal & Token-Efficient)
💡 Token Budget & Slimming: All tool descriptions are strictly kept within 250 characters (total description characters ≤ 1000), while detailed routing guidance is delegated to
McpServer({ instructions }), significantly reducing LLM context consumption.
| Tool Name | Purpose | Key Highlights |
| :--- | :--- | :--- |
| search | Federated web & code search (16 engines) | Supports parallel queries, timeRange: day\|week\|month\|year date filter, site: string[] filter, and query operators (site:, filetype:, after:, before:, -exclude) translated per engine with local post-filtering; fetchTop preview injection, code engine (grep.app); explicit engines defaults to minResults=0 (no unconstrained cascade); returns inline diagnostics on failure |
| fetchWebContent | Web page extraction, Markdown & transparent PDF parsing | All-in-one content extractor: Built-in disk-level Markdown cache (Node 22 node:sqlite / partitioned JSON fallback, 200MB LRU, cache: default\|reload); transparent PDF parsing (up to 20MB / 50 pages, [page N] tags, scanned doc detection); pagination & focus keyword targeting (bm25 relevance-ranked blocks by default, window for the legacy fixed window); selector to scope extraction to a CSS subtree (errors instead of silently returning the whole page); extract for CSS-selector JSON with no LLM; citations for numbered references; retainLinks to strip URLs (-50% on index pages) |
| fetchGithubContent | Comprehensive GitHub / Gitee content reader & code symbol search | Fetches README, **source
Truncated for display — read the full file on GitHub.
Related Skills
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
ruflo
81.9k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
headroom
79.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
CowAgent
48.0kOpen-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
