SkillAgentSearch skills...

local-ai-harness

Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-compatible engine or cloud model. Tuned for AMD Strix Halo.

Install / Use

npx skills add aic0d3r/local-ai-harness

Installs into whichever agent you are using.

About this skill
📦

Other

Other agent config

Quality Score

85/100

Supported Platforms

Universal

Our assessment of local-ai-harness

local-ai-harness scores 85/100 on our quality scale, 576th of 947 AI & Machine Learning skills we index.

Its Other is 8.6 KB long, well organised into 18 sections with 4 code examples: a thorough specification that gives an agent plenty to work with.

It has 38 GitHub stars, so there is little community track record yet; judge it on its content.

Substance
29/30
Structure
20/20
Description
15/15
Adoption
7/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated yesterday, so local-ai-harness is actively maintained.
  • Our last check on 2026-11-13 found the source still online.
  • It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
  • Its trust signals score 97/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

Safety scan

No issues found

Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below). An AI review of the same text found nothing harmful.

  • noteInstalls by piping a downloaded script into a shellline 67
    irm https://pi.dev/install.ps1 | iex

AI review by kimi-k2.7-code on 2026-11-10. Automated pattern scan on 2026-11-10. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.

local-ai-harness compared with similar skills

All 4 of these similar skills score higher than local-ai-harness; compare them before choosing.

SkillScoreStarsUpdatedFormat
local-ai-harness (this skill)by aic0d3r85381d agoOther
claude-memby thedotmack100117.6ktodayCLAUDE.md
Understand-Anythingby Egonex-AI10092.8k1d agoCLAUDE.md
headroomby headroomlabs-ai10079.8ktodayCLAUDE.md
CowAgentby zhayujie10048.0ktodayCLAUDE.md

Frequently asked questions

How do I install local-ai-harness?
Run npx skills add aic0d3r/local-ai-harness. The install tabs above show the steps for each supported agent.
Which AI agents does local-ai-harness work with?
It is written for Universal, as a Other file. Other agents that read the same format can often use it too.
Is local-ai-harness safe to use?
Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below). An AI review of the same text found nothing harmful. It is MIT-licensed and scores 97/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is local-ai-harness still maintained?
The repository was last updated yesterday, so local-ai-harness is actively maintained.

Local AI Harness for Coding Agents

Run a coding agent on a local model, on any hardware. Built on pi. Linux, and Windows (beta). Tuned and measured on AMD Strix Halo.

  • Detects your GPU and RAM, recommends an engine and model, and sizes limits to your context window.
  • Switches engines: Strata, llama.cpp, vLLM, Ollama, LM Studio, halogen, gufo, or a cloud model.
  • Cuts tokens: compressed command output, symbol-level code tools, search by meaning.
  • Resumes after a crash: relaunch, say "continue".
git clone https://github.com/aic0d3r/local-ai-harness && cd local-ai-harness
./setup.sh   # detects your hardware and engines, asks a few questions, installs only after you confirm

On Windows, see Windows (beta).

<div align="center">

Release Hardware Cloud License

Install • Which engine • Quick start • Efficiency • Docs • Posts

</div>

Local AI harness: one command, ./harness use, switches the coding agent between Strata, halogen, gufo, llama.cpp, vLLM, Ollama and LM Studio. Linux, Windows (beta)

Install

You need pi (setup installs it with npm if missing) and uvx from uv for semantic and web search.

git clone https://github.com/aic0d3r/local-ai-harness && cd local-ai-harness

# Linux, any engine: start your engine first (Ollama, llama.cpp, Strata, ...), then run the guided wizard
./setup.sh

# Strix Halo with the halogen checkpoint: needs docker and the ~124 GB model files
./setup.sh --halogen auto
./start.sh ~/my-project

# check the install any time; it ends with a live model ping
./setup.sh --doctor

The wizard asks every question first, shows a summary, and installs nothing until you confirm. Flags and the full walkthrough: docs/SETUP.md. Do not clone the whole model repo (~190 GB); --halogen auto fetches exactly the files you need.

Windows (beta)

setup.ps1 is verified on a clean Windows 11 VM against a stub engine, not yet on Windows hardware with a real Strata. In PowerShell:

# 1. Install Strata with its own installer and start it: https://github.com/Niko1221/Strata
# 2. Install pi
irm https://pi.dev/install.ps1 | iex
# 3. Get the harness and set pi up against the running Strata
git clone https://github.com/aic0d3r/local-ai-harness
cd local-ai-harness
powershell -ExecutionPolicy Bypass -File .\setup.ps1   # offers Git, Python, uv and Serena through winget; asks before each

No Git yet? Download the repo as a ZIP from GitHub, extract it, and run the last command in that folder. setup.ps1 never installs or starts an engine, and the ./harness wizard, launchers and sidecar are Linux only. Steps and limits: docs/WINDOWS.md.

Which engine

Any OpenAI-compatible server works. Start it, run ./setup.sh (or ./harness use <engine>), and skip --halogen. Only the Strix Halo numbers are measured here; nothing on NVIDIA or Apple was tested. Off halogen you lose the NPU tools (list).

| your hardware | engine | why | |---|---|---| | Strix Halo (Ryzen AI Max, 128 GB unified) | halogen | fastest measured, plus the NPU tools (guard, triage, dedup) | | Strix Halo, want open source | gufo or Strata | both open, both lose the NPU tools; Strata decodes faster, gufo prefills faster | | NVIDIA RTX 20-50 / AMD RX 7000-9000, 12 GB+ VRAM | Strata | built for it; not measured here. ./harness recommend picks the model by RAM: an ISTA pack of Flash-Next, or Qwen3.6-35B-A3B from 32 GB | | Windows (beta) | Strata, then setup.ps1 | VM-tested only; see docs/WINDOWS.md | | Apple Silicon, anything else | run Strata natively and point pi at it (./setup.sh --strata <url>), or llama.cpp / MLX / Ollama / LM Studio | not measured here; the launchers are bash/Linux |

Measured speeds for halogen, gufo and Strata: BENCHMARKS.md.

Quick start

./start.sh ~/my-project   # starts your engine if it is down, re-checks the install, opens pi on it
./harness status          # what pi is pointed at
./harness use <engine>    # switch engine or model
./harness tune            # re-run the speed probe and re-size the limits
./harness monitor         # live prefill/decode dashboard for the active engine

Private by default: no API key, halogen makes no outbound calls, and only the DuckDuckGo search tool reaches the internet. Cloud models are a supported hybrid; screening, search and compaction stay on-device either way. All commands, daily use and uninstall: docs/SETUP.md.

Efficiency

Every layer keeps tokens and calls off the main model. Locally that cuts prefill time; on a cloud model it cuts the bill.

  • Symbol tools (serena): a function body in 822 chars instead of 13,980 to read the file.
  • Code search (semble): 17/18 vs 13/18 top-3 hits, 2-3x faster queries than the NPU pipeline it replaced.
  • Sidecar for commits and compaction: large commit diffs 18.5k to 7.1k tokens; compaction ~24 s non-blocking vs ~52 s.
  • Screenshots: a 1080×2400 phone screenshot drops from ~1,500 to ~600 Claude tokens.
  • Also: rtk output compression, tool-trim, image-prune, a warm prompt cache, and a prompt-injection gate.

Every lever and how it was measured: BENCHMARKS.md. What each extension does: extensions/README.md.

Crash recovery

Kill pi or the server mid-task, relaunch ./start.sh in the same directory and say "continue": progress-tracker wrote a checkpoint and the fresh session picks it up. Verified across six scenarios, including kill -9 at response 1, server death mid-task and 15-deep compaction chains (reliable to ~8-10 compactions). Limits: one pi task per repo (set PI_PROGRESS_FILE per task for parallel work), and a stale checkpoint is data, not instructions, so rm PROGRESS.md when switching tasks.

Strix Halo reference setup

The numbers in this repo come from an AMD Ryzen AI Max+ 395 running a 125B Qwen3.8 Flash-Next on the iGPU with 262k context, NPU models screening and routing prompts, and a ling-tiny sidecar writing commits and summaries. The stack, model files, NPU details and the halogen upgrade procedure: docs/STRIX-HALO.md.

Evidence

Local Qwen3.8 Flash-Next 125B vs GLM 5.3 cloud tiers on Strix Halo: time to first token and decode tokens per second

Measured on an ASUS ROG Flow Z13 (Ryzen AI Max+ 395, Radeon 8060S, 128 GB) at 70 W sustained. More charts and every number in this README, with its logged run: BENCHMARKS.md.

Documentation

Posts

License

MIT

Related Skills

View on GitHub
GitHub Stars38
CategoryAI
Updated1d ago
Forks0

Languages

Python

Trust signals

97/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

1 info
local-ai-harness — Other: Install & Safety Check | SkillAgent