SkillAgentSearch skills...

vid2context

MCP server, CLI and HTTP API that turn any video into context for AI agents and LLMs: YouTube transcripts, captions, speech-to-text, metadata, chapters and cited research briefs. Free-first, works with local LLMs or hosted AI.

Install / Use

claude mcp add nirholas -- npx -y github:nirholas/vid2context

If the server publishes to npm under a different name, use that package instead — check the repo README.

About this skill
🔌

MCP Server

Model Context Protocol server

Quality Score

83/100

Supported Platforms

Claude Code
Claude Desktop
Gemini CLI

Our assessment of vid2context

vid2context scores 83/100 on our quality scale, 655th of 944 AI & Machine Learning skills we index.

Its MCP Server is 25 KB long, well organised into 22 sections with 12 code examples: a thorough specification that gives an agent plenty to work with.

It has 3 GitHub stars, so there is little community track record yet; judge it on its content.

Substance
30/30
Structure
20/20
Description
15/15
Adoption
3/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated today, so vid2context is actively maintained.
  • It is released under the Apache-2.0 license, a permissive license that allows use, modification and commercial use with attribution.
  • Its trust signals score 92/100, with 1 caution from licensing, adoption, age or documentation. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

vid2context compared with similar skills

All 4 of these similar skills score higher than vid2context; compare them before choosing.

SkillScoreStarsUpdatedFormat
vid2context (this skill)by nirholas833todayMCP Server
claude-memby thedotmack100118.5ktodayCLAUDE.md
Agent-Reachby Panniantong100113.3k12d agoCLAUDE.md
Understand-Anythingby Egonex-AI10093.3k1d agoCLAUDE.md
hyperframesby heygen-com10087.1ktodayCLAUDE.md

Frequently asked questions

How do I install vid2context?
Run claude mcp add nirholas -- npx -y github:nirholas/vid2context. The install tabs above show the steps for each supported agent.
Which AI agents does vid2context work with?
It is written for Claude Code, Claude Desktop and Gemini CLI, as a MCP Server file. Other agents that read the same format can often use it too.
Is vid2context safe to use?
It is Apache-2.0-licensed and scores 92/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is vid2context still maintained?
The repository was last updated today, so vid2context is actively maintained.

vid2context

npm npm License: Apache-2.0 Node 22+

Turn any video into context for AI agents. An MCP server, CLI, HTTP API and library that gives Claude, ChatGPT, Cursor, VS Code Copilot and any other agent the transcript, metadata and chapters of a video, playlist, podcast or media file, with timestamps it can cite.

Try it now, no install: paste a link into vid2context.com/app, or run npx vid2context <link> (CLI) or npx vid2context-mcp (MCP server). Works with YouTube, X (Twitter) posts, podcasts, Bilibili, Vimeo, Loom, the 1,000+ sites yt-dlp supports, and local files.

The vid2context web app: a YouTube link goes in, and the transcript, SRT captions, chapters and a context pack for agents come out

The web app on an 18 minute YouTube video: paste the link, then copy or download the transcript, captions, chapters or a context pack sized for an agent. Recorded live against the local API, shown at 2x speed. MP4 version.

Paste a video link or drop in a media file. vid2context returns the transcript, metadata and chapters in a form your agent can read and cite: plain text with [m:ss] timestamps, JSON, Markdown, SRT, VTT, or one Markdown context pack for many videos that you can upload to ChatGPT Projects, Claude Projects or a custom GPT.

It is free first. Local models run first, then hosted free tiers with your own key, then keyless hosts that need no account. Paid APIs are used last, and only when you set their key. With zero configuration it already works.

$ vid2context https://www.youtube.com/watch?v=jNQXAC9IVRw --timestamps
[0:01] All right, so here we are, in front of the elephants
[0:05] the cool thing about these guys is that they have really...
[0:07] really really long trunks
[0:12] and that's cool

Why

Research happens on video. A playlist explaining which used car to buy, a conference talk, a course, a podcast. Agents cannot watch any of it. vid2context turns those videos into text with timestamps, so an agent can absorb a whole series and answer "which model year should I buy?" while citing the episode and the moment that said so.

Design rule: raw transcripts are always kept. Summaries, briefs and extractions are an added layer, never a replacement.

How it works

For every input, vid2context resolves the source, fetches metadata and chapters, then walks a fallback chain until it has a transcript:

  1. Creator-uploaded captions
  2. Platform auto-captions
  3. Download the audio and run speech-to-text
  4. Video model mode, where a multimodal model watches the video so on-screen text, slides and code are captured too (planned)

Each speech-to-text and LLM step runs through a rung chain. A rung is one provider, one model and one credential. Rungs are tried in tier order and the chain falls through on errors, rate limits and outages, with cooldowns so a failing rung is skipped for a while. Every attempt is recorded, so you can always see what was tried and why it succeeded or failed:

Attempts:
  resolve  ok      youtube  youtube:jNQXAC9IVRw
  metadata ok      youtube
  captions ok      youtube-captions  creator-captions

| Tier | Meaning | Example | | ------- | ------------------------------ | -------------------------------- | | local | Your machine, free and private | Ollama, LM Studio, speaches | | free | Hosted free tier, your own key | Groq, Cerebras, Gemini AI Studio | | keyless | Hosted, no account needed | OVH AI Endpoints, Pollinations | | paid | Last backstop, only with a key | OpenAI |

Status

Version 0.2.0 (release notes), on npm as vid2context-mcp and vid2context. Everything below is built and covered by tests that replay real recorded responses.

| Area | What you get | | --- | --- | | Sources | YouTube (videos, Shorts, playlists, channels, comments, no key), any of the 1,000+ sites yt-dlp supports, Bilibili, X (Twitter) posts, Vimeo, Loom and Wistia transcripts, direct media URLs, Google Drive, Dropbox and OneDrive share links, local files, and every video embedded in a web page | | Speech-to-text | Local whisper.cpp and Transformers.js (offline), any OpenAI-compatible server, Groq, Mistral, DeepInfra, Together, Cloudflare Workers AI, OVH (keyless), OpenAI | | LLMs | Ollama, LM Studio, llama.cpp, vLLM and other local servers, in-browser WebLLM, free tiers (Groq, Cerebras, Gemini, Mistral, GitHub Models, NVIDIA, SambaNova, OpenRouter :free), keyless hosts, native Anthropic, Gemini and Vertex | | Output | text, JSON, Markdown with timestamp links, SRT, VTT, the context pack, and a .zip bundle with all of them | | Intelligence | Cited briefs across videos, Q&A with timestamp citations, schema extraction templates, translation, auto-chapters, key moments, on-screen text and slides from video frames, duplicate and reupload detection, SponsorBlock segments | | Library | Collections fed from playlists, channels and feeds, keyword and vector search, on SQLite, Postgres with pgvector, or Cloudflare D1 and R2 | | Surfaces | CLI, stdio MCP server (28 tools), remote MCP over Streamable HTTP with OAuth for ChatGPT and Claude.ai, HTTP API with OpenAPI, web app, chat app, browser extension, Telegram, Discord and Slack bots, LangChain.js loader, n8n nodes, Obsidian and Notion export | | Deploy | Docker, Cloud Run, Railway, Alibaba Cloud, Cloudflare Workers, Vercel, GitHub Pages (client only) |

Planned: video mode, where a multimodal model watches the whole video. The --mode video flag exists, but no provider implements it yet.

Quick start (zero keys)

No install: open the web app at vid2context.com/app, paste a link and get every format as a file, a .zip, or text to paste into an agent. This is the real result for "Me at the zoo":

The vid2context web app showing the result for "Me at the zoo": metadata, a creator captions badge, ten generated files and the context.md preview

Then open it in chat and ask questions. Answers cite the moment in the video they came from, here using a free model with no key:

The vid2context chat answering "What does he say about the elephants?" with a citation chip linking to Me at the zoo at 0:05

On your machine, it requires Node.js 22 or newer.

npx vid2context "https://www.youtube.com/watch?v=jNQXAC9IVRw" --timestamps

From source:

git clone https://github.com/nirholas/vid2context.git
cd vid2context
npm install
npm run cli -- "https://www.youtube.com/watch?v=jNQXAC9IVRw" --timestamps

A local audio or video file works too. With no keys set, it is transcribed by the keyless OVH Whisper rung:

npm run cli -- ./interview.mp3 --format json > interview.json

More in docs/examples: runnable examples for the library, CLI, HTTP API, MCP, LangChain and Python, each a file in examples/ whose output on the page is checked by the tests.

CLI

vid2context <input> [flags]            same as `vid2context get <input>`
vid2context <command> [args] [flags]

  get         Transcript and metadata for one video (the default command)
  list        Expand a playlist, channel, feed or page into video refs
  pack        One context pack (Markdown for an AI model) from one or many videos
  bundle      A .zip with every format, the context pack and a README for agents
  search      Keyword search over transcripts saved in the library
  library     Saved video contexts
  collection  Named groups of videos in the library
  models      Every rung by tier, whether it is enabled, and the env vars it needs
  doctor      Check Node, ffmpeg, yt-dlp, GPU, local servers, data directory, keys and network
  config      Resolved settings and where each came from, secrets masked
  serve       Start the HTTP API
  mcp         Start the stdio MCP server
  formats, completion, help

Common flags: -f, --format text|json|markdown|srt|vtt|pack|ass|ttml|sbv|lrc|csv, -t, --timestamps, --mode auto|captions|stt|video, --lang <code>, --policy free|local-only|quality, --only and --skip (rung ids or services), --json, -o, --out <file>, --verbose. Run vid2context help <command> for the rest. Full reference: docs/cli.md.

Program output goes to stdout and everything else to stderr, so vid2context URL > transcript.txt stays clean. On failure the CLI prints the error code, a hint on how to fix it, and every attempt that was made, and exits with a code per failure kind (3 unsupported input, 4 not found, 6 no transcript, 9 rate limited, 10 auth, and so on).

Use it from your agent

The MCP server is the npm package vid2context-mcp, listed in the MCP Registry as io.github.nirholas/vid2context. It needs no keys.

Install in VS Code Install in VS Code Insiders Install in Cursor

Claude Code

claude mcp add --scope user --transport stdio vid2context -- npx -y vid2context-mcp

Codex, Gemini CLI

codex mcp add vid2context -- npx -y vid2context-mcp
gemini extensions install https://github.com/nirholas/vid2context

Claude Desktop, Cursor, Windsurf, Cline and other clients

{
  "mcpServers": {
    "vid2context": { "command": "npx", "args": ["-y", "vid2context-mcp"] }
  }
}

To pass a key, add "env": { "GROQ_API_KEY": "..." } to the entry. Agents setting this up for you can follow llms-install.md.

From source

From the repo root:

claude mcp add vid2context -- "$PWD/node_modules/.bin/tsx" "$PWD/packages/mcp/src/bin.ts"

Tools

Ask your agent something like "get the transcript of https://youtu.be/jNQXAC9IVRw and summarize it with timestamps". The server exposes 28 tools:

| Group | Tools | | --- | --- | | One video | get_transcript, get_metadata, get_outline (chapters with token counts, start here for long videos), get_section, get_comments, get_key_moments, get_skip_segments, list_caption_languages, choose_caption_track, list_formats | | Many videos | list_items (expand a playlist, channel, feed or page), research_videos, export_context_pack, find_duplicates, digest_videos | | Library | create_collection, add_to_collection, get_collection, list_collections, search_transcript | | Answers | ask (Q&A with ti

Truncated for display — read the full file on GitHub.

Related Skills

View on GitHub
GitHub Stars3
CategoryAI
Updated8h ago
Forks1

Languages

TypeScript

Trust signals

92/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

1 low
vid2context — MCP Server: Install & Safety Check | SkillAgent