portaljs-add-dataset
Add a dataset (CSV, TSV, JSON, or GeoJSON) to an existing PortalJS portal. Appends an entry to datasets.json so the catalog and showcase render it automatically; routes the data by source (local file vs remote URL) — R2 via Git LFS by default, remote URLs by passthrough
Install / Use
npx skills add datopian/portaljs --skill portaljs-add-datasetInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
AutomationSupported Platforms
Our assessment of portaljs-add-dataset
portaljs-add-dataset scores 93/100 on our quality scale, 673rd of 2,780 Automation skills we index (top 25%).
Its SKILL.md is 6.2 KB long, well organised into 12 sections with 4 code examples: a thorough specification that gives an agent plenty to work with.
With 2,356 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 2 months ago, so portaljs-add-dataset is actively maintained.
- Our last check on 2026-10-26 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
ReviewOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review judged it risky: The skill instructs the agent to read and follow a remote `.claude/commands/portaljs-add-dataset.md` from GitHub as the 'single source of truth', creating a live external instruction channel that could change after review.
AI review: risky
- The skill instructs the agent to read and follow a remote `.claude/commands/portaljs-add-dataset.md` from GitHub as the 'single source of truth', creating a live external instruction channel that could change after review.
- It grants broad Bash tool prefixes (`npm:*`, `npx:*`, `git:*`, `curl:*`, `cp:*`, `mkdir:*`) plus `WebFetch`, `Read`, `Write`, and `Edit`, which the remote or local workflow can use to run arbitrary commands and modify files.
- The stated purpose is legitimate (registering a dataset in a PortalJS portal), but the combination of remote instruction loading and wide shell access meaningfully weakens the agent's safeguards.
AI review by kimi-k2.7-code on 2026-09-30. Automated pattern scan on 2026-09-29. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
portaljs-add-dataset compared with similar skills
All 4 of these similar skills score higher than portaljs-add-dataset; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| portaljs-add-dataset (this skill)by datopian | 93 | 2.4k | 2mo ago | SKILL.md |
| Agent-Reachby Panniantong | 100 | 112.3k | 8d ago | CLAUDE.md |
| rufloby ruvnet | 100 | 81.9k | today | CLAUDE.md |
| Claude-Code-Game-Studiosby Donchitos | 100 | 39.7k | 7d ago | CLAUDE.md |
| Scraplingby D4Vinci | 100 | 103.6k | 2d ago | MCP Server |
Frequently asked questions
- How do I install portaljs-add-dataset?
- Run
npx skills add datopian/portaljs --skill portaljs-add-dataset. The install tabs above show the steps for each supported agent. - Which AI agents does portaljs-add-dataset work with?
- It is written for Claude Code, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is portaljs-add-dataset safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review judged it risky: The skill instructs the agent to read and follow a remote
.claude/commands/portaljs-add-dataset.mdfrom GitHub as the 'single source of truth', creating a live external instruction channel that could change after review. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand. - Is portaljs-add-dataset still maintained?
- The repository was last updated about 2 months ago, so portaljs-add-dataset is actively maintained.
Skill content
View source on GitHubname: portaljs-add-dataset description: Add a dataset (CSV, TSV, JSON, or GeoJSON) to an existing PortalJS portal. Appends an entry to datasets.json so the catalog and showcase render it automatically; routes the data by source (local file vs remote URL) — R2 via Git LFS by default, remote URLs by passthrough. Use when registering a new dataset in a scaffolded portal. allowed-tools: Read, Write, Edit, Bash(npm:), Bash(npx:), Bash(git:), Bash(curl:), Bash(mkdir:), Bash(cp:), WebFetch version: 1.0.0 author: Datopian hello@datopian.com license: MIT compatibility: Claude Code with PortalJS portals (Next.js 14, React 18, Node 18+). Runs from any project via the plugin, a personal ~/.claude/commands install, or a portaljs clone. tags:
- portaljs
- data-portal
- dataset
- csv
- geojson
- catalog
PortalJS — Add Dataset
Overview
Register a dataset in a PortalJS (portaljs-catalog) portal. The skill appends one entry to
datasets.json — the single source of truth for the catalog — and routes the underlying
bytes by source first, then size: a local file defaults to R2 via Git LFS, a remote URL
defaults to passthrough (no copy). No per-dataset page is created; the catalog at /search
lists the new entry and the dynamic showcase route pages/[owner]/[slug].tsx renders it
automatically at /@<namespace>/<slug>. Supported formats for the showcase preview: CSV,
TSV, JSON (array), and GeoJSON.
Prerequisites
- A scaffolded PortalJS portal (see
portaljs-new-portal) withdatasets.json,package.json, andpages/[owner]/[slug].tsxpresent. - The source data: a local file path or a publicly reachable URL.
- For the R2/Git LFS default route:
gitandgit-lfsinstalled, and an Arc account token (or an OSS Giftless key) to mint a push-scoped LFS credential. - Node 18+ and npm available in the portal directory.
Instructions
The canonical, full step-by-step workflow is
.claude/commands/portaljs-add-dataset.md —
the single source of truth. Read and follow it when executing. Summary:
- Gather input from
$ARGUMENTS— source (file path or URL), portal directory (default.), dataset name/slug, description, namespace. If the source is missing, interview the user; never dead-end. - Validate the portal directory: confirm
datasets.json,package.json, andpages/[owner]/[slug].tsxexist. - Detect the format from the file extension, URL extension, or
Content-Typeheader (CSV, TSV, JSON array, or GeoJSON); reject anything else and ask for a conversion. - Route the data by source: remote URL → passthrough (default) or adopt into R2 (opt-in);
local file → R2 via Git LFS (default) or inline into
public/data/(fenced exception for bundled samples or an OSS-no-R2 fallback). - Append one entry to
datasets.json—slug,namespace,name,description,file(the routed path/URL),format— keeping(namespace, slug)unique. - Verify the build with
npx next build; fix errors (commonly malformed JSON) before reporting success. - Report the route taken, the manifest change, and the showcase URL.
Output
- Modified:
datasets.json(one entry appended). - Created (route-dependent):
data/<slug>.<ext>tracked via Git LFS (R2 default), orpublic/data/<slug>.<ext>(inline exception). Nothing is created for remote passthrough. - Verified:
npx next buildpasses. - Result: the dataset appears in
/searchand renders at/@<namespace>/<slug>.
Error Handling
| Symptom | Cause | Fix |
| --- | --- | --- |
| Fetch fails for a URL source | Non-200 status or unreachable host | Report the HTTP status and ask the user to confirm the URL is publicly accessible. |
| "Not a portaljs-catalog portal" | datasets.json missing | This is an older single-page template; ask the user how to proceed rather than failing silently. |
| Unsupported format | Extension/content-type isn't csv/tsv/json/geojson | Ask the user to convert the source before continuing. |
| git lfs push has nothing to stream | git lfs install --local never ran, so raw bytes were committed instead of a pointer | Run git lfs install --local before git lfs track, re-add and re-commit the file. |
| R2 PUT returns 400 | A broad http.extraHeader was set and replayed onto the presigned URL | Use the _jwt Basic-auth piggyback in lfs.url only — never a global http.extraHeader. |
| (namespace, slug) clash | Another entry already uses that pair | Ask the user for a different slug or namespace. |
| next build fails | Malformed JSON in datasets.json | Print the build log, fix the JSON, rebuild before reporting success. |
Examples
Example 1 — Local CSV, default R2 route
/portaljs-add-dataset ./data/co2-emissions.csv namespace=climate
Moves the file into data/, tracks it with Git LFS, pushes it to R2, and appends a manifest
entry whose file is the resulting https://data.portaljs.com/... URL.
Example 2 — Remote URL, passthrough (no download)
/portaljs-add-dataset https://example.org/open-data/trade.csv namespace=trade
Detects the format from the response headers and records the URL as-is in datasets.json —
no bytes are copied.
Example 3 — GeoJSON adopted into R2
/portaljs-add-dataset https://example.org/boundaries.geojson namespace=reference adopt=true
Downloads the file, then routes it as a local file through the Git LFS → R2 path so it is hosted and versioned under the portal (useful when in-browser range queries are needed).
Example 4 — Bundled sample data, inline exception
/portaljs-add-dataset ./samples/demo.csv namespace=reference
When the portal has no R2 credentials (OSS self-host) or the file is bundled sample data,
the skill copies it into public/data/ instead, per the .gitattributes inline fence.
Resources
- Full workflow:
.claude/commands/portaljs-add-dataset.md - Manifest fields and routing details:
references/reference.md - Related skills:
portaljs-new-portal,portaljs-add-chart,portaljs-add-map,portaljs-define-schema - Git LFS documentation: https://git-lfs.com/
Related Skills
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
ruflo
81.9k🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning intelligence, federation, vector RAG integration, and native Claude Code / Codex / Hermes and many more Integrated
Claude-Code-Game-Studios
39.7kTurn Claude Code into a full game dev studio — 49 AI agents, 72 workflow skills, and a complete coordination system mirroring real studio hierarchy.
Scrapling
103.6k🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
