arcgis-to-portaljs
Migrate a whole ArcGIS Hub site into a PortalJS Arc portal end-to-end. Harvests the Hub /data.json (DCAT-US) inventory, exports every FeatureService layer through the ArcGIS REST query API with resultOffset paging, converts each to the serverless dual tier (PMTiles render + GeoParquet query) with ta…
Install / Use
npx skills add datopian/portaljs --skill arcgis-to-portaljsInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
Development & EngineeringSupported Platforms
Our assessment of arcgis-to-portaljs
arcgis-to-portaljs scores 91/100 on our quality scale, 1065th of 4,700 Development & Engineering skills we index (top 23%).
Its SKILL.md is 7.8 KB long, well organised into 11 sections with 3 code examples: a thorough specification that gives an agent plenty to work with.
With 2,356 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 2 months ago, so arcgis-to-portaljs is actively maintained.
- Our last check on 2026-10-29 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-09-30. Automated pattern scan on 2026-09-29. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
arcgis-to-portaljs compared with similar skills
All 4 of these similar skills score higher than arcgis-to-portaljs; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| arcgis-to-portaljs (this skill)by datopian | 91 | 2.4k | 2mo ago | SKILL.md |
| taste-skillby Leonxlnx | 100 | 116.8k | 8d ago | CLAUDE.md |
| Agent-Reachby Panniantong | 100 | 112.3k | 8d ago | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 79.8k | today | CLAUDE.md |
| ai-job-searchby ai-job-search-dev | 100 | 72.1k | today | CLAUDE.md |
Frequently asked questions
- How do I install arcgis-to-portaljs?
- Run
npx skills add datopian/portaljs --skill arcgis-to-portaljs. The install tabs above show the steps for each supported agent. - Which AI agents does arcgis-to-portaljs work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is arcgis-to-portaljs safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is arcgis-to-portaljs still maintained?
- The repository was last updated about 2 months ago, so arcgis-to-portaljs is actively maintained.
Skill content
View source on GitHubname: arcgis-to-portaljs description: Migrate a whole ArcGIS Hub site into a PortalJS Arc portal end-to-end. Harvests the Hub /data.json (DCAT-US) inventory, exports every FeatureService layer through the ArcGIS REST query API with resultOffset paging, converts each to the serverless dual tier (PMTiles render + GeoParquet query) with tabular items to Parquet, pushes everything to Cloudflare R2 via Git LFS, appends dual-tier datasets.json entries, and writes a source-vs-derived parity report. Use to move a City or sector ArcGIS Hub open-data portal onto PortalJS with no server-side compute. allowed-tools: Read, Write, Edit, Bash(ogr2ogr:), Bash(ogrinfo:), Bash(tippecanoe:), Bash(duckdb:), Bash(git:), Bash(curl:), Bash(jq:), Bash(npx:), Bash(node:), Bash(mkdir:), Bash(cp:), Bash(wc:), Bash(command:*), WebFetch version: 0.1.0 author: Datopian hello@datopian.com license: MIT compatibility: Claude Code with PortalJS portals (Next.js 14, React 18/19, Node 18+). Requires native GDAL, tippecanoe, duckdb, and jq on the operator's machine (macOS or Linux/WSL). Runs from any project via the plugin, a personal install, or a portaljs clone. tags:
- portaljs
- data-portal
- migration
- arcgis
- geospatial
- pmtiles
ArcGIS Hub → PortalJS
Overview
Migrate an entire ArcGIS Hub open-data site into a PortalJS Arc portal in one pass.
Every Hub site is machine-readable — a DCAT-US catalog at /data.json, with every dataset
backed by an ArcGIS REST FeatureService — so migration is a harvest → export → convert →
publish → verify pipeline that runs almost fully automated on the operator's machine, no
server-side compute. The tooling is the reusable arcgis-to-portaljs migrator: input is one
Hub URL, output is a ready-to-deploy PortalJS catalog plus a parity report.
The skill is an orchestrator: it reuses the DCAT-US harvest from portaljs-migrate, the
ogr2ogr/tippecanoe/duckdb dual-tier conversion from portaljs-add-geo, and the bulk
Git-LFS → R2 push from portaljs-migrate. Its novel parts are the FeatureService REST export
loop (paged features, not just a link) and the source-vs-derived parity report.
Prerequisites
- A scaffolded PortalJS portal whose template ships
components/MapPreview.tsxandcomponents/GeoQuery.tsx(PR #1647 or later). Runportaljs-new-portalfirst if none. - Native CLIs: GDAL (
ogr2ogr,ogrinfo), tippecanoe, duckdb (withspatial), and jq. macOS:brew install gdal tippecanoe duckdb jq; Debian/Ubuntu:apt-get install gdal-bin duckdb jqplus tippecanoe (apt or build from source); Windows via WSL. The skill hard-stops with the install hint if any is missing. - Arc credentials for the Git-LFS → R2 push (the token
portaljs-deployresolves), or an OSS self-hosted Giftless.
Instructions
The canonical, full step-by-step workflow is
.claude/commands/arcgis-to-portaljs.md
— the single source of truth. Read and follow it when executing. Summary:
- Gather input — Hub URL, portal directory, project slug, optional flags (
--limit,--only,--dry-run,--namespace-mode). Interview if missing; never dead-end. - Check native tools (
ogr2ogr,tippecanoe,duckdb+spatial,jq). Any missing → print the per-OS install and stop. - Validate the portal directory and confirm the geo showcase components exist.
- Harvest the Hub
/data.json(reuse theportaljs-migrateDCAT-US map) and classify each item: vector (FeatureService), table, or non-data (web map / 3D / imagery → skipped). Under--namespace-mode owner, resolve namespaces through a publisher-normalization table with title-prefix fallback for broken{{source}}publishers (multi-publisher Hubs ship dirty publisher labels). Dedup near-duplicate hosted-viewlayers — but only after a mandatory live record-count check on BOTH twins: equal ⇒ dedup (keep the source layer, log the pair); different ⇒ keep both as distinct datasets. Consolidate per-year dataset series into one year-partitioned Parquet with legacy per-year view entries. Enrich from the AGOL item: sanitized metadata (license/description/dates), cleaned display title (cleanTitle— raw title still drives the slug),category(item categories → meaningful theme → keyword mapping), and athumbnailsnapshot intopublic/thumbnails/. - Export each vector layer through the ArcGIS REST
queryAPI withresultOffsetpaging (f=geojson,outSR=4326); fall back to keyset paging on transfer limits; accept a customer File Geodatabase dump for very large layers. - Convert each layer to the dual tier via the
portaljs-add-georecipe (PMTiles + GeoParquet); tabular items to Parquet. Preserve the native-CRS original. - Publish — bulk Git-LFS track + one push to R2 through Giftless, then append dual-tier
datasets.jsonentries (upsert on(namespace, slug)). - Write
arcgis-parity-report.md— record count, extent, attribute schema, and geometry validity, source vs derived, per dataset, plus the migrated/skipped/failed accounting. - Report the inventory, migrated datasets, R2 push, and parity summary.
Output
- Created:
data/<namespace>/<slug>.pmtiles,.parquet, and the original per vector dataset (all LFS-tracked → R2); Parquet + original per table;arcgis-parity-report.md. - Modified:
datasets.json(one dual-tier entry per vector dataset, one resource entry per table);.gitattributes(LFS tracking). - Verified: the parity report compares each derived artifact to the live FeatureService.
- Result:
/@<namespace>/<slug>renders<MapPreview>+<GeoQuery>for each vector dataset with no page edits; the catalog lists everything migrated.
Error Handling
| Symptom | Cause | Fix |
| --- | --- | --- |
| MISSING_INPUT | No Hub URL provided | Pass the site root (e.g. https://hub-lewisville.opendata.arcgis.com) and retry. |
| MISSING_TOOLS | ogr2ogr/tippecanoe/duckdb/jq (or duckdb spatial) absent | Print the per-OS install line and stop; re-run after installing. |
| NOT_A_PORTAL | Target dir has no datasets.json / geo components | Run portaljs-new-portal first, then re-run. |
| HARVEST_FAILED | /data.json unreachable or not DCAT-US | Confirm the site is an ArcGIS Hub and the feed loads in a browser. |
| EXPORT_FAILED | One FeatureService layer errored or hit a hard transfer cap | Logged and skipped; try keyset paging or a customer FGDB dump for that layer. |
| LFS_PUSH_FAILED | Missing/expired Arc token or unset lfs.url | Re-mint the JWT (see portaljs-deploy); confirm git config lfs.url. |
Examples
Example 1 — Migrate a City Hub (Lewisville)
/arcgis-to-portaljs https://hub-lewisville.opendata.arcgis.com slug=lewisville
Example 2 — Dry-run inventory + plan only (no writes)
/arcgis-to-portaljs https://streamwaterdata.co.uk --dry-run
Example 3 — Migrate a subset, one namespace per publisher
/arcgis-to-portaljs https://streamwaterdata.co.uk --only sewer-catchments,water-boundaries --namespace-mode owner
Resources
- Full workflow:
.claude/commands/arcgis-to-portaljs.md - REST export, classification, parity, and phasing details:
references/reference.md - Ongoing sync, parity dashboard, and cutover (Phase 3):
references/sync-and-cutover.md - Related skills:
portaljs-migrate,portaljs-add-geo,portaljs-add-dataset,portaljs-deploy - ArcGIS REST query API: https://developers.arcgis.com/rest/services-reference/enterprise/query-feature-service-layer/ · tippecanoe: https://github.com/felt/tippecanoe · DuckDB spatial: https://duckdb.org/docs/extensions/spatial
Related Skills
taste-skill
116.8kAgent skills that give coding agents taste: art direction, reference images and a browser check instead of generic AI pages
Agent-Reach
112.3kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
headroom
79.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
ai-job-search
72.1kThe job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
