<p align="center"> <img src="https://github.com/jonigl/mcp-client-for-ollama/blob/main/misc/ollmcp-logo-512.png?raw=true" width="256" /> </p> <p align="center"> <i>A simple yet powerful Python client for interacting with Model Context Protocol (MCP) servers using Ollama, allowing you to harness local LLMs for advanced tool execution.</i> </p> <p align="center"> <b>English</b> | <a href="README.zh-CN.md">简体中文</a> | <a href="README.es.md">Español</a> </p>

---

MCP Client for Ollama (ollmcp)

<p align="center"> _{Sponsored by} <br> <a href="https://www.atlascloud.ai/?utm_source=github&utm_medium=link&utm_campaign=mcp-client-for-ollama"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://github.com/jonigl/mcp-client-for-ollama/blob/main/misc/atlascloud-logo-dark.png?raw=true"> <img src="https://github.com/jonigl/mcp-client-for-ollama/blob/main/misc/atlascloud-logo.png?raw=true" alt="Atlas Cloud" height="20"> </picture> </a> <br> _{Learn how to use Atlas Cloud with ollmcp in the <a href="#sponsors">Sponsors</a> section} </p> <p align="center"> <img src="https://raw.githubusercontent.com/jonigl/mcp-client-for-ollama/v0.27.0/misc/ollmcp-demo.gif" alt="MCP Client for Ollama Demo"> </p> <p align="center"> <a href="https://asciinema.org/a/875917" target="_blank">🎥 Watch this demo as an Asciinema recording</a> </p>

Table of Contents

• Overview
• Features
• Requirements
• Quick Start
• Installation Options
• Troubleshooting
• ✨NEW Managing MCP Servers via CLI
  • mcp add options
  • Scopes
  • Command-line Arguments
    • MCP Server Configuration
    • ✨NEW Inference Provider Configuration
    • General Options
  • ✨NEW Supported Inference Providers
    • API key resolution order
  • Usage Examples
  • How Tool Calls Work
  • Agent Mode
• Interactive Commands
  • MCP Tools
  • MCP Prompts
  • MCP Resources
  • ✨NEW Answer Display Modes
  • Input Mode
  • Model Selection
  • Advanced Model Configuration
  • ✨NEW Thinking Mode and Reasoning Effort
  • Server Reloading for Development
  • Human-in-the-Loop (HIL) Tool Execution
    • Human-in-the-Loop (HIL) Configuration
  • Performance Metrics
  • History Management
• Autocomplete and Prompt Features
  • Typer Shell Autocompletion
  • FZF-style Autocomplete
  • MCP Prompts Autocomplete
  • Contextual Prompt
• Configuration Management
  • ✨NEW Per-provider profiles
• Server Configuration Format
  • Tips: Where to Put MCP Server Configs and a Working Example
• Compatible Models
  • Ollama Cloud Models
• ✨NEW Sponsors
  • Atlas Cloud
  • Become a sponsor
• Where Can I Find More MCP Servers?
• Related Projects
• Security
• License
• Acknowledgments

Overview

MCP Client for Ollama (ollmcp) is a modern, interactive terminal application (TUI) built for harness engineering, connecting local Ollama LLMs to one or more Model Context Protocol (MCP) servers. By fully supporting the core MCP primitives (tools, prompts, and resources), it provides a controlled terminal space where you steer, and the agent executes. With a rich, user-friendly interface, it lets you safely manage your setup in real time with no coding required. Whether you're building, testing, or exploring, this client streamlines your workflow with features like fuzzy autocomplete, advanced model configuration, MCP server hot-reloading for rapid development, and strict Human-in-the-Loop safety controls.

Features

• 🤖 Agent Mode: Iterative tool execution when models request multiple tool calls, with a configurable loop limit and interactive choices when the limit is reached (continue, wrap up, or abort)
• 🌐 Multi-Server Support: Connect to multiple MCP servers simultaneously
• 🚀 Multiple Transport Types: Supports STDIO, SSE, and Streamable HTTP server connections
• 📋 MCP Prompts Support: Browse, invoke, and manage prompts from MCP servers with argument collection, preview, and safe rollback
• 📦 MCP Resources Support: Browse and read contextual data from MCP servers including files, documents, and structured data
• ☁️ Ollama Cloud Support: Works seamlessly with Ollama Cloud models for tool calling, enabling access to powerful cloud-hosted models while using local MCP tools
• 🌍 Multiple LLM Providers: Use Ollama (default) or OpenAI-compatible providers (OpenAI, OpenRouter, DeepSeek, etc.), with connection settings remembered per provider
• 🎨 Rich Terminal Interface: Interactive console UI with modern styling
• 🌊 Streaming Responses: View model outputs in real-time as they're generated
• 📝 Answer Display Modes: Switch between Plain, Markdown, Both, or Markdown (blocks) response views while streaming
• 🛠️ Tool Management: Enable/disable specific tools or entire servers during chat sessions
• 🧑‍💻 Human-in-the-Loop (HIL): Review and approve tool executions before they run for enhanced control and safety
• 🎮 Advanced Model Configuration: Fine-tune 15+ model parameters including context window size, temperature, sampling, repetition control, and more
• 💬 System Prompt Customization: Define and edit the system prompt to control model behavior and persona
• 🧠 Context Window Control: Adjust the context window size (num_ctx) to handle longer conversations and complex tasks
• 🎨 Enhanced Tool Display: Beautiful, structured visualization of tool executions with JSON syntax highlighting
• 🧠 Context Management: Control conversation memory with configurable retention settings
• 🤔 Thinking Mode: Advanced reasoning capabilities with visible thought processes for supported models (e.g., gpt-oss, deepseek-r1, qwen3, etc.)
• 💪 Reasoning Effort Levels: Set reasoning effort to auto, minimal, low, medium, high, or xhigh for supported models
• 🖼️ Vision Tool Support: Images returned by tools are automatically forwarded to vision-capable models
• 🗣️ Cross-Language Support: Seamlessly work with both Python and JavaScript MCP servers
• 📜 History Management: View full conversation history, export to JSON for backup/analysis, and import previous sessions for continuity
• 🔍 Auto-Discovery: Automatically find and use Claude's existing MCP server configurations
• 🔁 Dynamic Model Switching: Switch between any installed Ollama model without restarting
• 💾 Configuration Persistence: Save and load tool preferences and model settings between sessions
• 🔄 Server Reloading: Hot-reload MCP servers during development without restarting the client
• ✨ Fuzzy Autocomplete: Interactive, arrow-key command autocomplete with descriptions
• 🏷️ Dynamic Prompt: Shows current model, thinking mode, and enabled tools
• 📊 Performance Metrics: Detailed model performance data after each query, including duration timings and token counts
• 🔌 Plug-and-Play: Works immediately with standard MCP-compliant tool servers
• 🔔 Update Notifications: Automatically detects when a new version is available
• 🖥️ Modern CLI with Typer: Grouped options, shell autocompletion, and improved help output
• ⏹️ Abort Generation: You can abort model generation at any time by pressing 'a' during response streaming

Requirements

• Python 3.11+ (Installation guide)
• Ollama running locally (Installation guide)
  • After installation, run ollama list to see available models. If no models are installed, you can pull one using ollama pull <model_name>. For example, ollama pull gemma4:latest.
• UV package manager (Installation guide)

Quick Start

Install ollmcp via pip, add an MCP server, and run the client:

# Install ollmcp via uv
uv tool install --upgrade ollmcp
# or via pip
pip install --upgrade ollmcp
# Add an MCP server (example: playwright stdio server)
ollmcp mcp add playwright -- npx @playwright/mcp@latest
# Run the client (check optional flags with `ollmcp --help`)
ollmcp # once running, use /help for interactive commands

Installation Options

Option 1: Install with uv and run (recommended)

uv tool install --upgrade ollmcp
ollmcp

Option 2: Install with pip and run

pip install --upgrade ollmcp
ollmcp

Option 3: Only run without installing (requires uv package manager)

uvx ollmcp

Option 4: Install from source and run using virtual environment

git clone https://github.com/jonigl/mcp-client-for-ollama.git
cd mcp-client-for-ollama
uv run -m mcp_client_for_ollama

Troubleshooting

Could not find a version that satisfies the requirement ollmcp (from versions: none)

This almost always means the Python you are using is older than the required 3.11+. This is common on macOS, where the system Python (/usr/bin/python3) or the Xcode-bundled Python can be 3.9 or older. When no release matches requires-python >= 3.11, pip filters out every version and reports the misleading "from versions: none".

First check your version:

python3 --version   # must be 3.11 or newer

Then install with a modern Python. The simplest option is uv, which fetches a suitable Python for you automatically:

uv tool install --upgrade ollmcp   # recommended, installs the CLI in an isolated environment
# or, if you prefer pip, make sure to use a Python 3.11+ interpreter:
python3.11 -m pip install --upgrade ollmcp
# Then run the client:
ollmcp

Take a look at the Installation Options.

error: externally-managed-environment (PEP 668)

On recent Debian/Ubuntu (Python 3.12+), the system pip is intentionally locked to protect OS-managed packages, so pip install ollmcp is blocked. This is a system policy (PEP 668), not an issue with ollmcp. Install it into an isolated environment instead:

uv tool install --upgrade ollmcp   # recommended, installs the CLI in an isolated environment
# or, if you prefer pip, use a virtual environmen