url-dump
Quick capture URLs with automatic content extraction, insights, and categorization into knowledge booklets
Install / Use
npx skills add huytieu/COG-second-brain --skill url-dumpInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
AutomationSupported Platforms
Tags
Our assessment of url-dump
url-dump scores 90/100 on our quality scale, 1243rd of 2,780 Automation skills we index (top 45%).
Its SKILL.md is 14 KB long, well organised into 63 sections with 7 code examples: a thorough specification that gives an agent plenty to work with.
With 1,216 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 2 months ago, so url-dump is actively maintained.
- Our last check on 2026-10-30 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-10-06. Automated pattern scan on 2026-10-05. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
url-dump compared with similar skills
All 4 of these similar skills score higher than url-dump; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| url-dump (this skill)by huytieu | 90 | 1.2k | 59d ago | SKILL.md |
| Agent-Reachby Panniantong | 100 | 112.3k | 9d ago | CLAUDE.md |
| rufloby ruvnet | 100 | 81.9k | today | CLAUDE.md |
| Claude-Code-Game-Studiosby Donchitos | 100 | 39.7k | 7d ago | CLAUDE.md |
| Scraplingby D4Vinci | 100 | 103.6k | 2d ago | MCP Server |
Frequently asked questions
- How do I install url-dump?
- Run
npx skills add huytieu/COG-second-brain --skill url-dump. The install tabs above show the steps for each supported agent. - Which AI agents does url-dump work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is url-dump safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is url-dump still maintained?
- The repository was last updated about 2 months ago, so url-dump is actively maintained.
Skill content
View source on GitHubname: url-dump description: Quick capture URLs with automatic content extraction, insights, and categorization into knowledge booklets roles: [all] integrations: [web-fetch]
COG URL Dump Skill
Purpose
Transform raw URLs into structured, insightful knowledge entries through intelligent content extraction, categorization, and integration with the user's knowledge base. Quick capture with automatic insight generation.
When to Invoke
- User shares a URL they want to save
- User says "save this link", "bookmark this", "url dump", or "save for later"
- User pastes a URL and wants to capture it
- User wants to organize web resources into their knowledge base
Agent Mode Awareness
Check agent_mode in 00-inbox/MY-PROFILE.md frontmatter:
- If
agent_mode: team— delegate content extraction, analysis, and categorization to a sub-agent while handling user interaction directly. The sub-agent fetches URL content, generates insights, and returns structured results for filing. - If
agent_mode: solo(default) — handle everything directly in the conversation. No delegation.
Pre-Flight Check
Before executing, check for user profile:
- Look for
00-inbox/MY-PROFILE.mdin the vault - If NOT found:
Welcome to COG! It looks like this is your first time. Before we start, let's quickly set up your profile (takes 2 minutes). Would you like to run onboarding first, or should I proceed with default settings? - If found:
- Read the profile to get user's interests and projects
- Use interests to help with auto-categorization
- Check for existing booklet categories in
05-knowledge/booklets/
Process Flow
1. User Interaction & Input Collection
- Accept URL(s) from the user (single URL or batch)
- Optionally accept user's quick note about why they're saving this
- Accept any format: bare URL, markdown link, or with notes
Prompt:
What URL(s) would you like to save?
(You can paste one or more URLs, optionally with a note about why you're saving it)
2. URL Validation & Fetch
- Validate URL format
- Check if URL is accessible
- Detect duplicate URLs in existing knowledge base
- Fetch the web page content
Content Extraction
Extract from the page:
- Page Title: [extracted-title]
- Meta Description: [if available]
- Author: [if detected]
- Published Date: [if detected]
- Word Count: [estimated]
- Read Time: [X minutes]
- Main Content: [extracted body text]
- Key Headings: [list of H1/H2s]
3. Category Selection
Default Categories:
- Articles & Blogs: Long-form content, tutorials, opinion pieces
- Tools & Resources: Software, utilities, services, APIs
- Reference: Documentation, specs, standards
- Research: Papers, studies, academic content
- Inspiration: Design, ideas, creative references
- Videos & Media: YouTube, podcasts, multimedia
- News & Updates: Industry news, announcements
- Project-Specific: Related to a specific project (offer project list from MY-PROFILE.md)
- To Review: Unsure, save for later categorization
Custom Categories:
- Check
05-knowledge/booklets/for existing custom categories - Offer to create new category if needed
Auto-suggestion: Based on content analysis, suggest the most likely category but let user confirm or change.
4. Content Analysis and Processing
Phase 1: Content Classification
Determine:
- Content Category: [article|tool|reference|research|video|news|etc]
- Primary Topics: [topic1, topic2, topic3]
- Tone: [informative|opinion|tutorial|news|etc]
- Quality Assessment: [high|medium|low]
- Credibility Indicators: [author credentials, citations, etc]
Phase 2: Insight Extraction
Generate:
- Executive Summary: [2-3 sentences]
- Key Insights:
- [Insight 1 with context]
- [Insight 2 with context]
- [Insight 3 with context]
- Notable Quotes: [if any stand out]
- Action Items: [practical takeaways]
Phase 3: Relevance Assessment
Analyze:
- User Interest Match: [high|medium|low] - [which interests from profile]
- Project Relevance: [project-name] - [why relevant]
- Knowledge Gap: [yes|no] - [what gap it fills]
- Timeliness: [evergreen|current|dated]
- Uniqueness: [novel|common|duplicate-adjacent]
Phase 4: Cross-Reference
Identify connections to:
- Related Bookmarks: [existing similar saves]
- Related Braindumps: [if content connects]
- Related Projects: [if applicable]
- Suggested Tags: [tag1, tag2, tag3]
5. Generate Structured Output
Create bookmark file with this structure:
---
type: "url-bookmark"
category: "[category-name]"
domain: "[source-domain.com]"
date_saved: "YYYY-MM-DD"
date_accessed: "YYYY-MM-DD HH:MM"
url: "[original-url]"
title: "[page-title]"
author: "[author-if-available]"
published: "[publish-date-if-available]"
tags: ["#bookmark", "#category-tag", "#topic-tags"]
relevance: "[high|medium|low]"
status: "unread"
related_projects: ["project1", "project2"]
confidence: "[high|medium|low]"
---
# [Title]
## Quick Summary
[2-3 sentence summary of the content]
## Key Insights
- **Insight 1:** [description with context]
- **Insight 2:** [description with context]
- **Insight 3:** [description with context]
## Why This Matters
[Connection to user's interests/projects. What makes this worth saving?]
## User Note
[Original user note if provided, otherwise omit section]
## Content Highlights
[Key excerpts or quotes from the content - 200-400 words max]
## Practical Takeaways
- [ ] [Action item 1 if applicable] 📅 [YYYY-MM-DD = date +1 week from today]
- [ ] [Action item 2 if applicable] 📅 [YYYY-MM-DD = date +1 week from today]
## Related Knowledge
- **Similar Bookmarks:** [[bookmark1]], [[bookmark2]]
- **Connected Projects:** [[project1]]
- **Related Notes:** [[note1]], [[note2]]
## Source Details
| Field | Value |
|-------|-------|
| Domain | [domain] |
| Author | [author or "Unknown"] |
| Published | [date or "Unknown"] |
| Word Count | [~X words] |
| Read Time | [~X minutes] |
## Processing Notes
- **Extracted:** [timestamp]
- **Category Confidence:** [percentage]
- **Review Needed:** [yes|no] - [reason if yes]
---
*Processed by COG URL Curator*
Save to appropriate location:
- Standard:
05-knowledge/booklets/[category-slug]/[title-slug]-YYYY-MM-DD.md - Project-specific:
04-projects/[project-slug]/resources/[title-slug]-YYYY-MM-DD.md - Mixed/Unclear:
00-inbox/url-[title-slug]-YYYY-MM-DD.md
6. Tool/Resource Special Handling
For tools and software, use enhanced template:
---
type: "url-tool"
category: "tools"
domain: "[domain]"
url: "[url]"
title: "[tool-name]"
date_saved: "YYYY-MM-DD"
pricing: "[free|freemium|paid|enterprise]"
tags: ["#tool", "#category-tags"]
status: "to-evaluate"
---
# [Tool Name]
## What It Does
[1-2 sentence description]
## Key Features
- Feature 1
- Feature 2
- Feature 3
## Use Cases
- Use case 1
- Use case 2
## Pricing
[Pricing details if available]
## Why It's Relevant
[Connection to user's work/interests]
## Evaluation Status
- [ ] Sign up / try demo 📅 [YYYY-MM-DD = date +3 days from today]
- [ ] Test key features 📅 [YYYY-MM-DD = date +1 week from today]
- [ ] Compare with alternatives 📅 [YYYY-MM-DD = date +1 week from today]
- [ ] Decision: [use|pass|revisit] 📅 [YYYY-MM-DD = date +2 weeks from today]
## Notes
[Space for user's evaluation notes]
---
*Processed by COG URL Curator*
7. Batch Processing
For multiple URLs:
Processing [X] URLs...
1. [URL 1] → [category] → Saved to [path]
2. [URL 2] → [category] → Saved to [path]
3. [URL 3] → [category] → Saved to [path]
Summary:
- Articles: 2 saved
- Tools: 1 saved
- Total: 3 URLs processed
8. Confirm Completion
- Confirm file(s) created
- Show user: "URL saved to [file path]"
- Show quick summary: title, category, key insight preview
- Ask if they want to:
- Add another URL
- Deep-dive into the content
- Connect to specific project or braindump
Booklet Structure
URLs are organized into "booklets" (category folders):
05-knowledge/
└── booklets/
├── articles/
│ ├── _index.md (category overview - auto-created)
│ └── [article-entries].md
├── tools/
│ ├── _index.md
│ └── [tool-entries].md
├── reference/
│ ├── _index.md
│ └── [reference-entries].md
├── research/
│ ├── _index.md
│ └── [research-entries].md
├── inspiration/
│ ├── _index.md
│ └── [inspiration-entries].md
├── videos/
│ ├── _index.md
│ └── [video-entries].md
└── [custom-category]/
├── _index.md
└── [entries].md
Category Index Template
When creating a new category, also create an index file:
---
type: "booklet-index"
category: "[category-name]"
created: "YYYY-MM-DD"
last_updated: "YYYY-MM-DD"
entry_count: 0
---
# [Category Name] Booklet
## Description
[What this category contains]
## Recent Additions
[Auto-updated list - most recent 10 entries]
## Top Entries
[Manually curated or most-accessed entries]
## Tags in This Category
[List of common tags used]
## Related Categories
- [[other-category-1]]
- [[other-category-2]]
YAML Formatting Requirements
CRITICAL: All YAML frontmatter must use proper Obsidian-compatible formatting:
- All string values MUST be quoted with double quotes
- Arrays MUST use quoted strings:
["item1", "item2", "item3"] - URLs MUST be quoted to handle special characters
- Boolean values should NOT be quoted:
trueorfalse - Ensure proper YAML syntax to prevent parsing errors in Obsidian
Examples:
# CORRECT
type: "url-bookmark"
url: "https://example.com/path?query=value"
tags: ["#bookmark", "#article", "#ai"]
relevance: "high"
reviewed: false
# INCORRECT
type: url-bookmark
url: https://example.com/path?query=value
tags: [#bookmark, #article, #ai]
relevance: high
reviewed: "false"
Verification Protocols
Content Accuracy
- Title Verification: Ensure extracted title matches page
- Author Attribution: Verify author if stated
- Date Accuracy: Confirm publication date if shown
- Summary Fidelity: Ensure summary accurately represents content
Categorization Verification
- Category Fit: Confirm content matches selected category
- Tag Relevance: Verify tags accurately describe content
- Interest Alignment: Confirm relevance assessment is accurate
- Project Connection: Verify project relevance if claimed
Quality Checks
- Completeness: All required fields populated
- Formatting: Proper markdown and YAML syntax
- Links: All internal links valid
- Metadata: Frontmatter properly formatted
Uncertainty Handling
When Content is Unclear
- Paywalled Content: Note limitation, extract available preview
- Dynamic Content: Note if content may change
- Complex Content: Flag for manual review if needed
- Non-English: Note language, provide translation if possible
Confidence Indicators
- High Confidence (90%+): Clear content with obvious categorization
- Medium Confidence (70-89%): Generally clear with some ambiguity
- Low Confidence (50-69%): Significant ambiguity requiring user input
- Very Low Confidence (<50%): Major uncertainty, save to inbox
Always explicitly state confidence levels and reasoning in processing notes.
Loop Engineering
URL capture is a fetch-retry loop with a quality gate, not a single fetch-and-file. See .claude/skills/loop-engineering/SKILL.md for the shared vocabulary.
The loop (per URL): fetch → if the fetch fails or returns an empty/blocked body, retry a different way (https vs http, reader mode, an archive snapshot) → once content is present, run the quality gate → file it, or escalate to the user / save to inbox with a Review Needed flag.
The verifier (deterministic):
- Fetch returned a non
Truncated for display — read the full file on GitHub.
Related Skills
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
ruflo
81.9k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
Claude-Code-Game-Studios
39.7kTurn Claude Code into a full game dev studio — 49 AI agents, 72 workflow skills, and a complete coordination system mirroring real studio hierarchy.
Scrapling
103.6k🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
