video2dsprite
Turn one approved master still into a character's whole animated sprite set - one image-to-video clip per action (idle, walk, run, attack, jump, hurt, cast and so on), all from that still, generated through generate2dmedia route_media.py (the xAI API when a key is configured, else the local Grok CLI…
Install / Use
npx skills add 0x0funky/agent-sprite-forge --skill video2dspriteInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
DesignSupported Platforms
Our assessment of video2dsprite
video2dsprite scores 89/100 on our quality scale, 102nd of 260 Design skills we index (top 40%).
Its SKILL.md is 8.3 KB long, well organised into 15 sections with 4 code examples: a thorough specification that gives an agent plenty to work with.
With 4,184 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 4 months ago. That is recent enough to be usable, but agent tooling moves fast, so check the instructions against your agent's current version.
- Our last check on 2026-10-31 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 98/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-09-29. Automated pattern scan on 2026-09-29. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
video2dsprite compared with similar skills
All 4 of these similar skills score higher than video2dsprite; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| video2dsprite (this skill)by 0x0funky | 89 | 4.2k | 4mo ago | SKILL.md |
| taste-skillby Leonxlnx | 100 | 116.8k | 8d ago | CLAUDE.md |
| Agent-Reachby Panniantong | 100 | 112.3k | 8d ago | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 79.8k | today | CLAUDE.md |
| Scraplingby D4Vinci | 100 | 103.6k | 2d ago | MCP Server |
Frequently asked questions
- How do I install video2dsprite?
- Run
npx skills add 0x0funky/agent-sprite-forge --skill video2dsprite. The install tabs above show the steps for each supported agent. - Which AI agents does video2dsprite work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is video2dsprite safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 98/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is video2dsprite still maintained?
- The repository was last updated about 4 months ago. That is recent enough to be usable, but agent tooling moves fast, so check the instructions against your agent's current version.
Skill content
View source on GitHubname: video2dsprite description: "Grok Build ONLY. Turn a 2D character still into smooth animation sprites via image_gen/image_edit base → image_to_video (6s/10s run-in-place) → ffmpeg frames → magenta chroma-key → dense sampled sprites (strip/grid/GIF). Use when the user wants video-to-sprite, motion capture from generated video, smoother run/walk cycles from dense frames, or runs /video2dsprite. Do NOT use on Codex/Claude — only Grok Build has image_to_video. Prefer generate2dsprite for crisp pixel sheets without video."
Video2dsprite (Grok Build only)
Convert a base 2D character image into dense animation sprites using Grok Build's native video tools.
base still → image_to_video (in-place motion) → extract frames → chroma key → sample/normalize → strip / grid / GIF
Platform gate (read first)
| Runtime | Supported? |
| --- | --- |
| Grok Build (xAI) | Yes — requires image_gen / image_edit + image_to_video (or reference_to_video) |
| Codex / Claude / other agents | No — they lack Grok video tools. Tell the user this skill is Grok Build only and offer $generate2dsprite instead |
If image_to_video is missing from the tool list, stop and explain. Do not fake motion with code-drawn frames.
This skill is an optional denser-motion path. It does not replace $generate2dsprite:
| Use $generate2dsprite when… | Use $video2dsprite when… |
| --- | --- |
| Crisp pixel sheets, fixed grids, identity-critical heroes | User wants denser intermediate poses / smoother feeling loops |
| Attack/cast body sheets, prop packs, engine atlases | Experimenting with video-sourced run/walk/idle motion |
| Production default for most game sprites | User explicitly asks for video → frames → sprites |
Video softens pixels, drifts identity, and leaves chroma fringes. Always QC; for production heroes, prefer $generate2dsprite unless the user wants the video look.
Parameters
Infer from the user request:
subject: character / creature description, or path to existing stillaction:run|walk|idle|attack| custom motion phraseview: usuallyside(side-scroller).topdownis harder — warn and keep camera lockedduration:6(default) or10secondsframe_counts: which denser sets to export, default8,16,24,48cell_size: output sprite cell, default128anchor:feet(default for side locomotion) |centerbg: solid#FF00FF(required for chroma)name: output slugout_dir: working folder (default./sprites/video2dsprite/<name>/or project-relative)
Agent rules
- Grok-only. Refuse on non-Grok runtimes with a short explanation +
$generate2dspritealternative. - Still → video, never text-to-video alone. Stage frame 1 as a clean still (
image_genorimage_editfrom a reference). Then callimage_to_video. - In-place motion. Prompt for run/walk in place facing a fixed direction. No camera pan, no background scroll, no scene change. Subject stays roughly centered.
- Solid magenta background on the base and preserved in the video prompt (
#FF00FF/ pure magenta). Required for flood-fill chroma. - Do not invent art with PIL/Canvas. Base art comes from
image_gen/image_editor a user/local still. Scripts only postprocess. - Do not put experimental outputs into the game unless the user asks to integrate.
- Prefer one locomotion cycle for game use. Dense sample across a full 6s multi-cycle clip is fine for previews; for engine sheets, optionally re-sample a single cycle (12–16 frames) after visual QC.
- Report absolute paths of video, cleaned frames, strips, and preview GIFs when done.
Workflow
1. Plan
Pick the smallest useful run:
- Side-view run/walk loop → this skill
- Multi-action hero kit → still use
$generate2dspriteper action; only use video for locomotion if requested - FX / projectile / prop packs →
$generate2dsprite, not video
Create:
<out_dir>/
base/
video/
frames-raw/
frames-clean/
sprite/ # default 8-frame set + denser x16/x24/x48
prompt-used.txt
pipeline-meta.json
README.txt
2. Build the base still
Options:
- A. Existing sprite: open with image tools / read image, composite onto solid
#FF00FFif needed - B. New character:
image_genwith solid magenta background, full body, side view, centered - C. Match reference:
image_editfrom user reference onto magenta, preserve identity
Base requirements:
- Full body visible, generous magenta margin
- Side view for run/walk (profile or 3/4 side), feet near bottom third
- Same art style as the rest of the project when a reference exists
- No text, UI, watermark, or second character
Save as <out_dir>/base/<name>-base.png.
Write the exact image prompt into prompt-used.txt.
3. Animate with image_to_video
Call Grok image_to_video:
image: path to the base stillduration:6(default) or10resolution_name:480punless user asks720pprompt: one short present-tense shot (see references/prompt-rules.md)
Mandatory motion constraints in the prompt:
- Subject runs/walks in place (treadmill style)
- Camera locked — no pan, zoom, or orbit
- Background stays flat solid magenta
- Identity, costume, palette stable for the whole shot
- Single continuous action only
Copy the returned video to <out_dir>/video/<name>-<duration>s.mp4.
If video tools are unavailable, stop (platform gate).
4. Extract + chroma + sample (local script)
Run the processor (ffmpeg + Pillow + numpy):
python skills/video2dsprite/scripts/video2dsprite.py process \
--video <out_dir>/video/<name>-6s.mp4 \
--out-dir <out_dir> \
--name <name> \
--frame-counts 8,16,24,48 \
--cell-size 128 \
--body-height 100 \
--foot-y 118 \
--fps 0
Notes:
--fps 0= extract every decoded frame (use source fps)- Magenta flood-fill from corners + despill
- Even sampling for each count in
--frame-counts - Feet-normalized cells, horizontal strip, grid, loop GIF per count
Optional: only re-sample denser sets from existing cleaned frames:
python skills/video2dsprite/scripts/video2dsprite.py sample \
--clean-dir <out_dir>/frames-clean \
--out-dir <out_dir> \
--frame-counts 16,24,48 \
--cell-size 128
5. QC
Visually check:
- [ ] Preview GIF loops without huge pops
- [ ] Magenta gone (no solid pink blocks); fringe acceptable or re-key
- [ ] Feet stay on a stable baseline (no hop from bad crop)
- [ ] Identity roughly stable (face/clothes not morphing every frame)
- [ ] Action is in-place (not sliding out of frame)
- [ ] For game use: pick one count (often 16 or 24) or cut one true cycle
If identity drifts hard or pixels are too soft, fall back to $generate2dsprite for production sheets and keep the video set as motion reference only.
6. Deliver
Report paths only (unless user asked to wire into a game):
- Video:
video/*.mp4 - Dense sprites:
sprite/x16|x24|x48/ - Strips / grids / GIFs:
sprite/run-strip-N.png,run-grid-N.png,run-preview-N.gif - Meta:
pipeline-meta.json
Do not modify game code unless requested.
Defaults
- Duration: 6s
- Action: side run in place, facing right
- Export counts: 8, 16, 24, 48
- Cell: 128², body height ~100, feet at y≈118
- Background: #FF00FF
- Prefer
image_to_videooverreference_to_video(compose multi-ref withimage_editfirst if needed)
Tradeoffs (tell the user once)
Pros: denser intermediates → often feels smoother than 4–8 discrete gen poses.
Cons: softer pixels, identity drift, chroma fringe, multi-cycle 6s clips are not a single perfect loop, heavier assets.
Rule of thumb: 8→16→24 usually gains smoothness; 48 is often diminishing returns; 145 raw frames are for sampling, not all for runtime.
Resources
- references/prompt-rules.md — base still + video prompts
- references/pipeline.md — folder layout, ffmpeg, sampling strategy
- scripts/video2dsprite.py — extract, chroma, normalize, export
Relationship to other skills
$generate2dsprite— primary sheet pipeline (Codex + Grok when image gen exists)$generate2dmap— maps; not used here$video2dsprite— Grok Build exclusive motion densification path
Related Skills
taste-skill
116.8kAgent skills that give coding agents taste: art direction, reference images and a browser check instead of generic AI pages
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
headroom
79.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Scrapling
103.6k🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
