prompt-engineer-toolkit
Tests, versions and scores production prompts: prompt linting, version diffs, eval-suite scoring with a CI gate
Install / Use
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkitInstalls into whichever agent you are using.
SKILL.md
Installable skill definition
Quality Score
Category
Development & EngineeringSupported Platforms
Our assessment of prompt-engineer-toolkit
prompt-engineer-toolkit scores 81/100 on our quality scale, 3531st of 4,702 Development & Engineering skills we index.
Its SKILL.md is 6.3 KB long, well organised into 8 sections and no code examples: a thorough specification that gives an agent plenty to work with.
It has 817 GitHub stars, a meaningful sign that others use it.
Maintenance, license and trust
- The repository was last updated about 2 months ago, so prompt-engineer-toolkit is actively maintained.
- Our last check on 2026-11-06 found the source still online.
- No license is declared. By default that means all rights are reserved: you can read it, but reusing or redistributing it is not clearly permitted. Ask the author before building on it commercially.
- Its trust signals score 88/100, with 1 caution from licensing, adoption, age or documentation. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.
AI review by kimi-k2.7-code on 2026-10-07. Automated pattern scan on 2026-10-07. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
prompt-engineer-toolkit compared with similar skills
All 4 of these similar skills score higher than prompt-engineer-toolkit; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| prompt-engineer-toolkit (this skill)by borghei | 81 | 817 | 57d ago | SKILL.md |
| taste-skillby Leonxlnx | 100 | 117.6k | 9d ago | CLAUDE.md |
| ai-job-searchby ai-job-search-dev | 100 | 72.3k | today | CLAUDE.md |
| claude-howtoby luongnv89 | 100 | 47.4k | 3d ago | CLAUDE.md |
| lobehubby lobehub | 100 | 85.7k | today | MCP Server |
Frequently asked questions
- How do I install prompt-engineer-toolkit?
- Run
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit. The install tabs above show the steps for each supported agent. - Which AI agents does prompt-engineer-toolkit work with?
- It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
- Is prompt-engineer-toolkit safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It declares no license and scores 88/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is prompt-engineer-toolkit still maintained?
- The repository was last updated about 2 months ago, so prompt-engineer-toolkit is actively maintained.
Skill content
View source on GitHubname: prompt-engineer-toolkit description: > Prompt engineering frameworks for building, testing, versioning, and evaluating prompts: chain-of-thought, few-shot, regression testing, and rubrics. Use when designing production prompts, running A/B tests, or building prompt libraries. license: MIT + Commons Clause metadata: version: 1.1.0 author: borghei category: engineering domain: ai-engineering tier: POWERFUL updated: 2026-06-17 frameworks: prompt-patterns, evaluation-rubrics, regression-testing, version-control
Prompt Engineer Toolkit — Production Prompt Engineering
The complete lifecycle for production prompts: design patterns that work, testing frameworks that catch regressions, versioning systems that track changes, and evaluation rubrics that replace subjective "looks good" with measurable quality. This treats prompts as production code with the same rigor — not clever tricks.
Tags: prompt engineering, chain-of-thought, few-shot, evaluation, testing, prompt versioning
Core Capabilities
- Prompt patterns — 6-layer system-prompt architecture, chain-of-thought (standard, scratchpad, self-consistency), few-shot design + dynamic selection, JSON/section output structuring, decomposition pipelines, calibration (temperature + confidence levels).
- Testing framework — test-case structure, suite composition (40/30/15/15), a 5-dimension automated scoring rubric with a weighted formula, and a regression-testing protocol.
- Versioning — version-control layout, changelog format with rationale/baselines/rollback, and a prompt-diff risk checklist.
- Failure-mode catalog — instruction override, format drift, sycophancy, verbosity, hallucination, anchoring, lost-in-the-middle, each with fixes.
- Lifecycle workflows — design a prompt, debug a degraded prompt, migrate a prompt to a new model.
When to Use
- Designing production prompts or building a prompt library.
- Running A/B tests or regression tests on prompt variants.
- Versioning prompts and gating changes on test scores.
- Debugging a degraded prompt or migrating prompts across models.
Clarify First
Before designing or testing the prompt, confirm these inputs. If any is unknown or vague, ASK — do not assume:
- [ ] Task & definition of "good" — what the prompt must produce and how success is judged (drives the 5-dimension evaluation rubric)
- [ ] Target model — calibration (temperature, few-shot count) and migration paths differ by model
- [ ] Lifecycle stage — design new / debug a degraded prompt / migrate to a new model (selects the workflow)
Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.
Tools
| Tool | Purpose | Command |
|------|---------|---------|
| eval_scorer.py | Score evaluation results from JSON test cases (exact/contains/regex) | python scripts/eval_scorer.py suite.json --fail-under 0.80 --json |
| prompt_analyzer.py | Analyze prompt files for clarity, instruction density, few-shot coverage, tokens | python scripts/prompt_analyzer.py my_prompt.txt --json |
| prompt_diff.py | Compare two prompt versions for structural changes, instruction deltas, risk | python scripts/prompt_diff.py v2.txt v3.txt --show-diff --json |
References
Load the reference that matches the task — keep this file lean and pull detail on demand:
- references/prompt-patterns-catalog.md — complete catalog of prompting techniques with examples: system-prompt architecture, chain-of-thought, few-shot, output structuring, decomposition, and calibration. Read when designing or structuring a prompt.
- references/testing-and-versioning.md — test-case design, suite composition, the evaluation rubric and scoring formula, the regression protocol, version-control strategy, changelog format, and diff analysis. Read when building a test suite or managing versions.
- references/failure-modes-and-workflows.md — common failure modes, the three lifecycle workflows, a quick-view integration table, the troubleshooting matrix, and success criteria. Read when debugging a prompt or running a workflow.
Scope & Limitations
This skill covers:
- Designing, structuring, and layering system prompts for production AI applications
- Building and running test suites, evaluation rubrics, and regression tests for prompt quality
- Versioning prompts with changelogs, baselines, and rollback plans
- Calibration techniques including temperature tuning, confidence levels, and few-shot selection
This skill does NOT cover:
- Fine-tuning or training models -- see
engineering/model-training-pipelinefor training workflows - Retrieval-augmented generation (RAG) pipeline design -- see
engineering/context-enginefor context retrieval architecture - Agent orchestration and multi-step tool use -- see
engineering/agent-designerfor agent system design - LLM infrastructure, hosting, or cost optimization -- see
engineering/llm-gateway-designfor inference infrastructure patterns
Integration Points
| Skill | Integration | Data Flow | |-------|-------------|-----------| | agent-designer | Agent system prompts are the highest-stakes prompts; use this toolkit to test and version them | Agent specs → prompt layers → tested system prompts | | self-improving-agent | Prompt degradation signals feed into self-improvement loops for automatic correction | Test suite results → regression alerts → prompt iteration | | context-engine | Retrieved context quality directly impacts prompt effectiveness; coordinate retrieval tuning with prompt testing | Retrieved chunks → prompt context layer → evaluation scores | | ab-test-setup | A/B test prompt variants in production with statistical rigor before full rollout | Prompt candidates → traffic split → scoring comparison → winner promotion | | llm-gateway-design | Gateway handles prompt routing, versioning, and model fallback at the infrastructure layer | Versioned prompts → gateway config → model routing → response logging | | code-review-automation | Code review prompts are high-frequency production prompts that benefit from this toolkit's testing framework | Review criteria → prompt design → test suite → deployed reviewer prompt |
Related Skills
taste-skill
117.6kAgent skills that give coding agents taste: art direction, reference images and a browser check instead of generic AI pages
ai-job-search
72.3kThe job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.
claude-howto
47.4kA visual, example-driven guide to Claude Code — from basic concepts to advanced agents, with copy-paste templates that bring immediate value.
lobehub
85.7k🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
