portaljs-check-data-quality
Audit a local or remote tabular file (CSV/TSV) for common data quality issues — schema, nulls, types, duplicates. Read-only
Install / Use
npx skills add datopian/portaljs --skill portaljs-check-data-qualityInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
Data & AnalyticsSupported Platforms
Our assessment of portaljs-check-data-quality
portaljs-check-data-quality scores 90/100 on our quality scale, 300th of 606 Data & Analytics skills we index (top 50%).
Its SKILL.md is 5.8 KB long, well organised into 12 sections with 4 code examples: a solid amount of guidance for an agent.
With 2,356 GitHub stars, it is one of the more widely adopted skills in the catalogue.
Maintenance, license and trust
- The repository was last updated about 2 months ago, so portaljs-check-data-quality is actively maintained.
- Our last check on 2026-10-30 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-09-30. Automated pattern scan on 2026-09-29. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
portaljs-check-data-quality compared with similar skills
All 4 of these similar skills score higher than portaljs-check-data-quality; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| portaljs-check-data-quality (this skill)by datopian | 90 | 2.4k | 2mo ago | SKILL.md |
| x402by browser-use | 100 | 121.0k | 3d ago | SKILL.md |
| algorithmic-artby anthropics | 100 | 177.9k | 55d ago | SKILL.md |
| pptxby anthropics | 100 | 177.9k | 55d ago | SKILL.md |
| designby nextlevelbuilder | 100 | 149.0k | 6d ago | SKILL.md |
Frequently asked questions
- How do I install portaljs-check-data-quality?
- Run
npx skills add datopian/portaljs --skill portaljs-check-data-quality. The install tabs above show the steps for each supported agent. - Which AI agents does portaljs-check-data-quality work with?
- It is written for Claude Code, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is portaljs-check-data-quality safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is portaljs-check-data-quality still maintained?
- The repository was last updated about 2 months ago, so portaljs-check-data-quality is actively maintained.
Skill content
View source on GitHubname: portaljs-check-data-quality description: Audit a local or remote tabular file (CSV/TSV) for common data quality issues — schema, nulls, types, duplicates. Read-only. Use when a dataset needs a quality check before publishing, or a showcase renders wrong (blank cells, garbled numbers, an unsortable date column) and the cause needs isolating. allowed-tools: Bash(curl:), Bash(awk:), Bash(sort:), Bash(head:), Bash(wc:*) version: 1.0.0 author: Datopian hello@datopian.com license: MIT compatibility: Claude Code with PortalJS portals (Next.js 14, React 18, Node 18+). Runs from any project via the plugin, a personal ~/.claude/commands install, or a portaljs clone. tags:
- portaljs
- data-portal
- data-quality
- audit
- csv
- validation
PortalJS — Check Data Quality
Overview
Run a read-only quality audit of one CSV or TSV file, local or remote, and return a
structured JSON report. The audit profiles every column — null/blank counts, inferred
value types, numeric ranges, likely year/date fields — and flags duplicate rows,
duplicate values in identifier-like columns, ambiguous overlapping year columns (e.g.
calendar year vs fiscal year), and mixed-type columns. It never edits the source
file, datasets.json, or any other project file; it only reads the target file (a
remote URL is downloaded to a temp file that is deleted before the run ends) and
prints a report. Use it before publishing a dataset with portaljs-add-dataset, or to
diagnose why a showcase renders wrong.
Prerequisites
python3onPATH— the audit logic runs as an embedded Python script; nothing is installed.- One CSV or TSV file, given as a local path or an
http/httpsURL. Only one file per run.
Instructions
The canonical, full step-by-step workflow is
.claude/commands/portaljs-check-data-quality.md —
the single source of truth. Read and follow it when executing. Summary:
- Gather input — the file path or URL to audit. If missing, ask for it; never dead-end.
- Resolve the source: if it's an
http/httpsURL, download it to a temp file first; otherwise use the local path as given. - Validate the extension is
.csvor.tsv. If not, or the file is missing, or the header row is empty, stop and surface the error JSON as-is — do not guess a fix. - Profile every column: null/blank counts, distinct values, sample values, inferred per-value type (boolean/integer/float/date/string), numeric min/max, and year range for columns whose name looks year-like.
- Derive findings from the profiles — duplicate rows, missing-value ratios, invalid
year values, mixed types, suspect negative values, duplicate identifier values, and
ambiguous overlapping year columns — each tagged
critical,warning, orinfo. - Assemble the JSON report (
status, file metadata,findings,recommendations,column_profiles), print it, and clean up the temp file if one was created. - Relay the report to the user as-is; do not modify the source file,
datasets.json, or any other project file based on the findings — that's a separate, explicit step.
Output
A single JSON object printed to stdout:
status—ok,warning, orcritical.file,file_name,source_type(localorurl),row_count,column_count.findings— structured issues, most severe first.recommendations— de-duplicated suggested next steps.column_profiles— per-column summary (nulls, blanks, distinct count, sample values, inferred types, numeric/year ranges).
No files are created or modified. A remote URL's temp download is removed on exit, success or failure alike.
Error Handling
| Symptom | Cause | Fix |
| --- | --- | --- |
| "File ... is not available." | Local path is wrong, or the URL download failed | Verify the path or URL is reachable and retry. |
| "Only CSV and TSV files are supported right now." | File extension isn't .csv/.tsv | Convert the file, or point to its tabular source instead. |
| "... does not contain tabular headers." | File is empty or the header row is malformed | Open the file and confirm it has a valid, non-empty header line. |
| Command hangs on a URL | Remote host is slow or blocks non-browser requests | Download the file manually and audit the local copy instead. |
| python3: command not found | Python 3 isn't installed or not on PATH | Install Python 3, or run the audit where it's available. |
| Report looks truncated in the terminal | Large report wrapped/paginated by the shell | Redirect to a file (> report.json) and open it separately. |
Examples
Example 1 — Audit a local CSV before publishing
/portaljs-check-data-quality ./public/data/trash.csv
Example 2 — Audit a remote CSV over HTTPS
/portaljs-check-data-quality https://example.com/trash.csv
Example 3 — Audit a TSV and save the report for review
bash scripts/check-data-quality.sh ./data/emissions.tsv > /tmp/emissions-quality.json
Example 4 — Read a critical status report
{
"status": "critical",
"findings": [
{ "severity": "critical", "check": "duplicate_rows", "message": "42 duplicate rows found." }
],
"recommendations": ["Review and deduplicate repeated rows if they are not intentional."]
}
Fix the flagged rows/columns, then re-run the audit before publishing.
Resources
- Full workflow:
.claude/commands/portaljs-check-data-quality.md - Detailed check catalog and troubleshooting:
references/reference.md - Related skills:
portaljs-add-dataset,portaljs-define-schema - Python
csvmodule (parsing behavior this audit relies on): https://docs.python.org/3/library/csv.html
Related Skills
x402
121.0kSet up Browser Use Cloud payments with x402 — pay per request from a crypto wallet (USDC on Base mainnet), no signup or API key.
algorithmic-art
177.9kCreating algorithmic art using p5.js with seeded randomness and interactive parameter exploration. Use this when users request creating art using code, generative art, algorithmic art, flow fields, or particle systems.
pptx
177.9kUse this skill any time a .pptx or .potx file is involved in any way — as input, output, or both. This includes: creating slide decks, pitch decks, or presentations; reading, parsing, or extracting text from any .pptx or .potx file (even if the extracted content will be used elsewhere, like in an em…
design
149.0kComprehensive design skill: brand identity, design tokens, UI styling, logo generation (55 styles, Gemini, Atlas Cloud, or MuAPI AI), corporate identity program (50 deliverables, CIP mockups), HTML presentations (Chart.js), banner design (22 styles, social/ads/web/print), icon design (15 styles, SVG…
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
