Astromesh
Multi-model AI agent runtime. Define agents in YAML, connect 6 LLM providers, orchestrate with ReAct/Plan&Execute/Fan-Out/Pipeline/Supervisor/Swarm patterns, and deploy as REST/WebSocket API with RAG, memory, MCP tools, guardrails, and OpenTelemetry observability.
Install / Use
/learn @monaccode/AstromeshREADME
Astromesh
Agent Runtime Platform for building AI agents
<p align="center"> <img src="assets/astromesh-logo.png" alt="Astromesh Logo" width="900" /> </p> <p align="center"> <a href="https://github.com/monaccode/astromesh/actions/workflows/ci.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/ci.yml/badge.svg?branch=main" alt="CI"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release.yml/badge.svg" alt="Release"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release-pypi.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release-pypi.yml/badge.svg" alt="PyPI Publish"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release-adk.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release-adk.yml/badge.svg" alt="ADK Publish"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/docs.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/docs.yml/badge.svg?branch=develop" alt="Docs"></a> <a href="https://github.com/monaccode/astromesh/releases/latest"><img src="https://img.shields.io/github/v/release/monaccode/astromesh?include_prereleases&label=version" alt="Version"></a> <a href="https://pypi.org/project/astromesh/"><img src="https://img.shields.io/pypi/v/astromesh?label=Astromesh%20PyPI" alt="Astromesh PyPI"></a> <a href="https://test.pypi.org/project/astromesh/"><img src="https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Ftest.pypi.org%2Fpypi%2Fastromesh%2Fjson&query=%24.info.version&label=Astromesh%20TestPyPI" alt="Astromesh TestPyPI"></a> <a href="https://pypi.org/project/astromesh-adk/"><img src="https://img.shields.io/pypi/v/astromesh-adk?label=ADK%20PyPI" alt="ADK PyPI"></a> <a href="https://test.pypi.org/project/astromesh-adk/"><img src="https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Ftest.pypi.org%2Fpypi%2Fastromesh-adk%2Fjson&query=%24.info.version&label=ADK%20TestPyPI" alt="ADK TestPyPI"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release-orbit.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release-orbit.yml/badge.svg" alt="Orbit Publish"></a> <a href="https://pypi.org/project/astromesh-orbit/"><img src="https://img.shields.io/pypi/v/astromesh-orbit?label=Orbit%20PyPI" alt="Orbit PyPI"></a> <a href="https://test.pypi.org/project/astromesh-orbit/"><img src="https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Ftest.pypi.org%2Fpypi%2Fastromesh-orbit%2Fjson&query=%24.info.version&label=Orbit%20TestPyPI" alt="Orbit TestPyPI"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release-node.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release-node.yml/badge.svg" alt="Node Release"></a> <a href="https://github.com/monaccode/astromesh/actions/workflows/release-cli.yml"><img src="https://github.com/monaccode/astromesh/actions/workflows/release-cli.yml/badge.svg" alt="CLI Release"></a> <a href="https://github.com/monaccode/astromesh/blob/develop/LICENSE"><img src="https://img.shields.io/github/license/monaccode/astromesh" alt="License"></a> <a href="https://www.python.org/"><img src="https://img.shields.io/badge/python-3.12%2B-blue" alt="Python 3.12+"></a> </p> <p align="center"> <a href="https://monaccode.github.io/astromesh/"><strong>Documentation</strong></a> · <a href="https://monaccode.github.io/astromesh/getting-started/quickstart/">Quick Start</a> · <a href="https://github.com/monaccode/astromesh/releases">Releases</a> </p>Build, orchestrate and run AI agents with multi-model routing, tools, memory, and RAG — all configured declaratively.
Astromesh is an open-source runtime for agentic systems, designed to standardize how AI agents execute, reason, and interact with external systems.
Think of it as Kubernetes for AI Agents.
⭐ If you find this project useful, consider starring the repository.
Why Astromesh
Most AI applications repeatedly rebuild the same infrastructure:
- model orchestration
- tool execution
- memory systems
- RAG pipelines
- agent reasoning loops
- observability
- cost control
Astromesh centralizes these capabilities into a single runtime platform.
Instead of writing orchestration logic yourself, you define agents declaratively and let the runtime manage execution.
Documentation
Full documentation site: monaccode.github.io/astromesh
Includes getting started guides, architecture deep-dives, 7 deployment modes, configuration reference, and API docs.
Additional references in this repo:
- Tech overview:
docs/TECH_OVERVIEW.md - General architecture:
docs/GENERAL_ARCHITECTURE.md - Kubernetes-style architecture diagrams:
docs/K8S_ARCHITECTURE.md - Configuration guide:
docs/CONFIGURATION_GUIDE.md - WhatsApp integration:
docs/WHATSAPP_INTEGRATION.md - Maia mesh guide:
docs/MAIA_GUIDE.md - Developer quick start:
docs/DEV_QUICKSTART.md - ADK quick start:
docs/ADK_QUICKSTART.md - ADK implementation status and pending work:
docs/ADK_PENDING.md - Cloud overview:
docs/CLOUD_OVERVIEW.md - Cloud quick start:
docs/CLOUD_QUICKSTART.md - Cloud API reference:
docs/CLOUD_API_REFERENCE.md - Installation (APT):
docs/INSTALLATION.md - Developer tools:
docs/DEVELOPER_TOOLS.md - Orbit overview:
docs/ORBIT_OVERVIEW.md - Orbit quick start:
docs/ORBIT_QUICKSTART.md - Orbit configuration:
docs/ORBIT_CONFIGURATION.md
Key Features
Multi-Model Runtime
Run agents across multiple LLM providers:
- Ollama
- OpenAI-compatible APIs
- vLLM
- llama.cpp
- HuggingFace TGI
- ONNX Runtime
The built-in Model Router automatically selects the best model using strategies such as:
- cost optimized
- latency optimized
- quality first
- round robin
- capability match
Multiple Agent Reasoning Patterns
Astromesh includes several orchestration strategies:
| Pattern | Description | |---|---| | ReAct | reasoning + tool usage loop | | Plan & Execute | generate plan then execute | | Pipeline | sequential processing | | Parallel Fan-Out | multi-model collaboration | | Supervisor | hierarchical agents | | Swarm | distributed agent collaboration |
Built-in Memory System
Agents can maintain multiple memory layers:
| Memory Type | Purpose | |---|---| | Conversational | chat history | | Semantic | vector embeddings | | Episodic | event logs |
Supported backends:
- Redis
- PostgreSQL
- SQLite
- pgvector
- ChromaDB
- Qdrant
- FAISS
Retrieval-Augmented Generation (RAG)
Astromesh includes a complete RAG pipeline:
- document chunking
- embeddings
- vector search
- reranking
- context injection
Supported vector stores:
- pgvector
- ChromaDB
- Qdrant
- FAISS
Tool System
Agents interact with external systems using tools:
| Type | Description | |------|-------------| | Built-in (18 tools) | web_search, http_request, sql_query, send_email, read_file, and more | | MCP Servers (3) | code_interpreter, shell_exec, generate_image | | Agent tools | Invoke other agents as tools for multi-agent composition | | Webhooks | Call external HTTP endpoints | | RAG | Query and ingest documents |
Tools are configured declaratively in agent YAML with zero-code setup for built-ins.
Messaging Channels
Astromesh supports external messaging integrations.
Current integration:
- WhatsApp (Meta Cloud API)
Future integrations:
- Slack
- Telegram
- Discord
- Web chat
- Voice assistants
Observability
Full observability stack with zero configuration:
- Structured tracing — span trees for every agent execution
- Metrics — counters and histograms (runs, tokens, cost, latency)
- Built-in dashboard — web UI at
/v1/dashboard/ - CLI access —
astromeshctl traces,astromeshctl metrics,astromeshctl cost - OpenTelemetry export — compatible with Jaeger, Grafana Tempo, etc.
- VS Code integration — traces panel and metrics dashboard in your editor
Developer Experience
Astromesh provides a complete developer toolkit:
| Tool | Description |
|------|-------------|
| CLI (astromeshctl) | Scaffold agents, run workflows, inspect traces, view metrics, validate configs |
| Copilot | Built-in AI assistant that helps build and debug agents |
| VS Code Extension | YAML IntelliSense, workflow visualizer, traces panel, metrics dashboard, copilot chat |
| Built-in Dashboard | Web UI at /v1/dashboard/ with real-time observability |
# Scaffold a new agent
astromeshctl new agent customer-support
# Run it
astromeshctl run customer-support "How do I reset my password?"
# See what happened
astromeshctl traces customer-support --last 5
# Check costs
astromeshctl cost --window 24h
# Ask the copilot for help
astromeshctl ask "Why is my agent slow?"
Architecture
Astromesh follows a layered architecture (see also docs/GENERAL_ARCHITECTURE.md for the full reference):
API Layer
REST / WebSocket
↓
Runtime Engine
Agent lifecycle and execution
↓
Core Services
Model Router · Memory Manager · Tool Registry · Guardrails
↓
Infrastructure
LLM Providers · Vector Databases · Observability · Storage Backends
