web-search-scraper-api-skill
This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API.
Install / Use
npx skills add browser-act/skills --skill web-search-scraper-api-skillInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
AutomationSupported Platforms
Our assessment of web-search-scraper-api-skill
web-search-scraper-api-skill scores 88/100 on our quality scale, 1502nd of 2,780 Automation skills we index.
Its SKILL.md is 5.1 KB long, well organised into 11 sections with 1 code example: a solid amount of guidance for an agent.
With 6,001 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 3 months ago, so web-search-scraper-api-skill is actively maintained.
- Our last check on 2026-11-01 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-10-06. Automated pattern scan on 2026-10-06. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
web-search-scraper-api-skill compared with similar skills
All 4 of these similar skills score higher than web-search-scraper-api-skill; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| web-search-scraper-api-skill (this skill)by browser-act | 88 | 6.0k | 3mo ago | SKILL.md |
| Agent-Reachby Panniantong | 100 | 112.3k | 9d ago | CLAUDE.md |
| rufloby ruvnet | 100 | 81.9k | today | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 79.8k | today | CLAUDE.md |
| Claude-Code-Game-Studiosby Donchitos | 100 | 39.7k | 7d ago | CLAUDE.md |
Frequently asked questions
- How do I install web-search-scraper-api-skill?
- Run
npx skills add browser-act/skills --skill web-search-scraper-api-skill. The install tabs above show the steps for each supported agent. - Which AI agents does web-search-scraper-api-skill work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is web-search-scraper-api-skill safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is web-search-scraper-api-skill still maintained?
- The repository was last updated about 3 months ago, so web-search-scraper-api-skill is actively maintained.
Skill content
View source on GitHubname: web-search-scraper-api-skill description: "This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactively apply this skill when users express needs like extract complete markdown from a specific website, scrape the content of an article link, get the text from a target url, convert a webpage to markdown format, fetch the main content of a blog post, extract data from a given web page, parse the html of a website into markdown, download the readable text from a news article, obtain the content of a tutorial page, extract all the markdown text from any http or https url, scrape documentation from a web link, or grab the text of a single webpage." metadata: {"openclaw":{"emoji":"🌐","requires":{"bins":["python"],"env":["BROWSERACT_API_KEY"]}}}
Web Search Scraper API Skill
📖 Introduction
This skill provides users with a one-stop web page extraction service through the BrowserAct Web Search Scraper API template. It can directly extract structured markdown content from any given URL. By simply inputting the target URL, you can get clean and usable markdown data.
✨ Features
- No hallucinations, ensuring stable and precise data extraction: Pre-set workflows avoid AI generative hallucinations.
- No human-machine verification issues: No need to deal with reCAPTCHA or other verification challenges.
- No IP access restrictions or geofencing: No need to handle regional IP limitations.
- More agile execution speed: Compared to purely AI-driven browser automation solutions, task execution is faster.
- Extremely high cost-effectiveness: Compared to AI solutions that consume a lot of Tokens, it can significantly reduce the cost of data acquisition.
🔑 API Key Guidance Process
Before running, you must check the BROWSERACT_API_KEY environment variable. If it is not set, do not take other actions first; you should ask and wait for the user to provide it cooperatively.
The Agent must inform the user at this time:
"Since you have not configured the BrowserAct API Key, please go to the BrowserAct Console first to get your Key."
🛠️ Input Parameters Details
Agent should flexibly configure the following parameters based on user needs when calling the script:
- target_url
- Type:
string - Description: The website URL to extract content from. Supports any HTTP/HTTPS URL.
- Example:
https://www.browseract.com
- Type:
🚀 Invocation Method (Recommended)
Agent should execute the following independent script to achieve "one command gets the result":
# Example invocation
python -u ./scripts/web_search_scraper_api.py "target_url"
⏳ Execution Status Monitoring
Since the task involves automated browser operations, it may take a long time (several minutes). The script will continuously output status logs with timestamps (e.g., [14:30:05] Task Status: running) while running.
Notice for Agent:
- While waiting for the script to return results, please keep paying attention to the terminal output.
- As long as the terminal is still outputting new status logs, it means the task is running normally. Do not misjudge it as a deadlock or unresponsiveness.
- If the status remains unchanged for a long time or the script stops outputting and no result is returned, the retry mechanism can be triggered.
📊 Data Output Description
Upon successful execution, the script will directly parse and print the result from the API response. The result contains:
content: The complete markdown content of the webpage.
⚠️ Error Handling & Retry Mechanism
During the execution of the script, if an error occurs (such as network fluctuation or task failure), the Agent should follow this logic:
-
Check the output content:
- If the output contains
"Invalid authorization", it means the API Key is invalid or expired. At this time, do not retry, and you should guide the user to recheck and provide the correct API Key. - If the output does not contain
"Invalid authorization"but the task execution fails (for example, the output starts withError:or the returned result is empty), the Agent should automatically try to re-execute the script once.
- If the output contains
-
Retry limit:
- Automatic retry is limited to once. If the second attempt still fails, stop retrying and report the specific error message to the user.
🌟 Typical Use Cases
- Article Extraction: Scrape the main content of a news article link into markdown.
- Blog Post Parsing: Download the readable text from a target blog post URL.
- Webpage to Markdown: Convert any given website URL into clean markdown format.
- Documentation Scraping: Fetch the contents of a tutorial or documentation page for offline reading.
- Content Monitoring: Automatically extract the text from a specific webpage for updates.
- Data Processing: Parse the HTML of an arbitrary HTTP/HTTPS URL to structure its content.
Related Skills
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
ruflo
81.9k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
headroom
79.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Claude-Code-Game-Studios
39.7kTurn Claude Code into a full game dev studio — 49 AI agents, 72 workflow skills, and a complete coordination system mirroring real studio hierarchy.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
