local-ai-harness
Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-compatible engine or cloud model. Tuned for AMD Strix Halo.
Install / Use
npx skills add aic0d3r/local-ai-harnessInstalls into whichever agent you are using.
Other
Other agent config
Quality Score
Category
AI & Machine LearningSupported Platforms
Our assessment of local-ai-harness
local-ai-harness scores 85/100 on our quality scale, 576th of 947 AI & Machine Learning skills we index.
Its Other is 8.6 KB long, well organised into 18 sections with 4 code examples: a thorough specification that gives an agent plenty to work with.
It has 38 GitHub stars, so there is little community track record yet; judge it on its content.
Maintenance, license and trust
- The repository was last updated yesterday, so local-ai-harness is actively maintained.
- Our last check on 2026-11-13 found the source still online.
- It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
- Its trust signals score 97/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.
Safety scan
No issues foundOur scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below). An AI review of the same text found nothing harmful.
- noteInstalls by piping a downloaded script into a shellline 67
irm https://pi.dev/install.ps1 | iex
AI review by kimi-k2.7-code on 2026-11-10. Automated pattern scan on 2026-11-10. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.
local-ai-harness compared with similar skills
All 4 of these similar skills score higher than local-ai-harness; compare them before choosing.
| Skill | Score | Stars | Updated | Format |
|---|---|---|---|---|
| local-ai-harness (this skill)by aic0d3r | 85 | 38 | 1d ago | Other |
| claude-memby thedotmack | 100 | 117.6k | today | CLAUDE.md |
| Understand-Anythingby Egonex-AI | 100 | 92.8k | 1d ago | CLAUDE.md |
| headroomby headroomlabs-ai | 100 | 79.8k | today | CLAUDE.md |
| CowAgentby zhayujie | 100 | 48.0k | today | CLAUDE.md |
Frequently asked questions
- How do I install local-ai-harness?
- Run
npx skills add aic0d3r/local-ai-harness. The install tabs above show the steps for each supported agent. - Which AI agents does local-ai-harness work with?
- It is written for Universal, as a Other file. Other agents that read the same format can often use it too.
- Is local-ai-harness safe to use?
- Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below). An AI review of the same text found nothing harmful. It is MIT-licensed and scores 97/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
- Is local-ai-harness still maintained?
- The repository was last updated yesterday, so local-ai-harness is actively maintained.
Skill content
View source on GitHubLocal AI Harness for Coding Agents
Run a coding agent on a local model, on any hardware. Built on pi. Linux, and Windows (beta). Tuned and measured on AMD Strix Halo.
- Detects your GPU and RAM, recommends an engine and model, and sizes limits to your context window.
- Switches engines: Strata, llama.cpp, vLLM, Ollama, LM Studio, halogen, gufo, or a cloud model.
- Cuts tokens: compressed command output, symbol-level code tools, search by meaning.
- Resumes after a crash: relaunch, say "continue".
git clone https://github.com/aic0d3r/local-ai-harness && cd local-ai-harness
./setup.sh # detects your hardware and engines, asks a few questions, installs only after you confirm
On Windows, see Windows (beta).
<div align="center">Install • Which engine • Quick start • Efficiency • Docs • Posts
</div>
Install
You need pi (setup installs it with npm if missing) and uvx from uv for semantic and web
search.
git clone https://github.com/aic0d3r/local-ai-harness && cd local-ai-harness
# Linux, any engine: start your engine first (Ollama, llama.cpp, Strata, ...), then run the guided wizard
./setup.sh
# Strix Halo with the halogen checkpoint: needs docker and the ~124 GB model files
./setup.sh --halogen auto
./start.sh ~/my-project
# check the install any time; it ends with a live model ping
./setup.sh --doctor
The wizard asks every question first, shows a summary, and installs nothing until you confirm. Flags and the full
walkthrough: docs/SETUP.md. Do not clone the whole model repo (~190 GB); --halogen auto fetches
exactly the files you need.
Windows (beta)
setup.ps1 is verified on a clean Windows 11 VM against a stub engine, not yet on Windows hardware with a real Strata.
In PowerShell:
# 1. Install Strata with its own installer and start it: https://github.com/Niko1221/Strata
# 2. Install pi
irm https://pi.dev/install.ps1 | iex
# 3. Get the harness and set pi up against the running Strata
git clone https://github.com/aic0d3r/local-ai-harness
cd local-ai-harness
powershell -ExecutionPolicy Bypass -File .\setup.ps1 # offers Git, Python, uv and Serena through winget; asks before each
No Git yet? Download the repo as a ZIP from GitHub, extract it, and run the last command in that folder.
setup.ps1 never installs or starts an engine, and the ./harness wizard, launchers and sidecar are Linux only. Steps
and limits: docs/WINDOWS.md.
Which engine
Any OpenAI-compatible server works. Start it, run ./setup.sh (or ./harness use <engine>), and skip --halogen. Only
the Strix Halo numbers are measured here; nothing on NVIDIA or Apple was tested. Off halogen you lose the NPU tools
(list).
| your hardware | engine | why |
|---|---|---|
| Strix Halo (Ryzen AI Max, 128 GB unified) | halogen | fastest measured, plus the NPU tools (guard, triage, dedup) |
| Strix Halo, want open source | gufo or Strata | both open, both lose the NPU tools; Strata decodes faster, gufo prefills faster |
| NVIDIA RTX 20-50 / AMD RX 7000-9000, 12 GB+ VRAM | Strata | built for it; not measured here. ./harness recommend picks the model by RAM: an ISTA pack of Flash-Next, or Qwen3.6-35B-A3B from 32 GB |
| Windows (beta) | Strata, then setup.ps1 | VM-tested only; see docs/WINDOWS.md |
| Apple Silicon, anything else | run Strata natively and point pi at it (./setup.sh --strata <url>), or llama.cpp / MLX / Ollama / LM Studio | not measured here; the launchers are bash/Linux |
Measured speeds for halogen, gufo and Strata: BENCHMARKS.md.
Quick start
./start.sh ~/my-project # starts your engine if it is down, re-checks the install, opens pi on it
./harness status # what pi is pointed at
./harness use <engine> # switch engine or model
./harness tune # re-run the speed probe and re-size the limits
./harness monitor # live prefill/decode dashboard for the active engine
Private by default: no API key, halogen makes no outbound calls, and only the DuckDuckGo search tool reaches the internet. Cloud models are a supported hybrid; screening, search and compaction stay on-device either way. All commands, daily use and uninstall: docs/SETUP.md.
Efficiency
Every layer keeps tokens and calls off the main model. Locally that cuts prefill time; on a cloud model it cuts the bill.
- Symbol tools (serena): a function body in 822 chars instead of 13,980 to read the file.
- Code search (semble): 17/18 vs 13/18 top-3 hits, 2-3x faster queries than the NPU pipeline it replaced.
- Sidecar for commits and compaction: large commit diffs 18.5k to 7.1k tokens; compaction ~24 s non-blocking vs ~52 s.
- Screenshots: a 1080×2400 phone screenshot drops from ~1,500 to ~600 Claude tokens.
- Also:
rtkoutput compression,tool-trim,image-prune, a warm prompt cache, and a prompt-injection gate.
Every lever and how it was measured: BENCHMARKS.md. What each extension does: extensions/README.md.
Crash recovery
Kill pi or the server mid-task, relaunch ./start.sh in the same directory and say "continue": progress-tracker wrote a
checkpoint and the fresh session picks it up. Verified across six scenarios, including kill -9 at response 1, server
death mid-task and 15-deep compaction chains (reliable to ~8-10 compactions). Limits: one pi task per repo (set
PI_PROGRESS_FILE per task for parallel work), and a stale checkpoint is data, not instructions, so rm PROGRESS.md
when switching tasks.
Strix Halo reference setup
The numbers in this repo come from an AMD Ryzen AI Max+ 395 running a 125B Qwen3.8 Flash-Next on the iGPU with 262k context, NPU models screening and routing prompts, and a ling-tiny sidecar writing commits and summaries. The stack, model files, NPU details and the halogen upgrade procedure: docs/STRIX-HALO.md.
Evidence

Measured on an ASUS ROG Flow Z13 (Ryzen AI Max+ 395, Radeon 8060S, 128 GB) at 70 W sustained. More charts and every number in this README, with its logged run: BENCHMARKS.md.
Documentation
- SETUP.md: the wizard step by step, flags, all commands, daily use, uninstall.
- ENGINES.md: which engine fits which hardware, what breaks off halogen, weights, cloud hybrid.
- WINDOWS.md: the beta setup steps and what is tested.
- STRIX-HALO.md: the halogen stack, model files, NPU, upgrading.
- BENCHMARKS.md: measured numbers and methodology.
- Local vs cloud comparison: seven runs on one real debugging task.
- llama.cpp path and Operations: the full-control engine; context size, watching speed, troubleshooting.
- extensions/README.md and CHANGELOG.md: per-extension notes; release history.
Posts
- Qwen3.8-27B on Strix Halo at 31 t/s decode, the full stack guide (r/LocalLLaMA)
- Running a local coding agent on Strix Halo with pi + llama.cpp (r/StrixHalo)
- Qwen3.8-Flash-Next on Strix Halo: 40 t/s sustained decode (r/StrixHalo)
License
Related Skills
claude-mem
117.6kPersistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More
Understand-Anything
92.8kGraphs that teach > graphs that impress. Turn any code into an interactive knowledge graph you can explore, search, and ask questions about. Works with Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.
headroom
79.8kCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
CowAgent
48.0kOpen-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.
Languages
Trust signals
From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.
