<p align="center"> <a href="https://agenta.ai?utm_source=github&utm_medium=referral&utm_campaign=readme"> <picture > <source width="275" media="(prefers-color-scheme: dark)" srcset="https://github.com/user-attachments/assets/97e31bfc-b1fc-4d19-b443-5aedf6029017" > <source width="275" media="(prefers-color-scheme: light)" srcset="https://github.com/user-attachments/assets/fdc5f23f-2095-4cfc-9511-14c6851c1262" > <img alt="Shows the logo of agenta" src="https://github.com/user-attachments/assets/fdc5f23f-2095-4cfc-9511-14c6851c1262" > </picture> </a> <div align="center"> <strong> <h1> The Open-source LLMOps Platform </h1></strong> Build reliable LLM applications faster with integrated prompt management, evaluation, and observability. </div> <br /> <div align="center" > <a href="https://cloud.agenta.ai?utm_source=github&utm_medium=referral&utm_campaign=readme"> <picture > <source media="(prefers-color-scheme: dark)" srcset="https://imagedelivery.net/UNvjPBCIZFONpkVPQTxVuA/6fa19a9d-9785-4acf-5d08-e81b1e38b100/large" > <source media="(prefers-color-scheme: light)" srcset="https://imagedelivery.net/UNvjPBCIZFONpkVPQTxVuA/6fa19a9d-9785-4acf-5d08-e81b1e38b100/large" > <img alt="Shows the logo of agenta" src="https://imagedelivery.net/UNvjPBCIZFONpkVPQTxVuA/6fa19a9d-9785-4acf-5d08-e81b1e38b100/large" > </picture> </a> </div> </div>

<h3 align="center"> <a href="https://agenta.ai/docs/?utm_source=github&utm_medium=referral&utm_campaign=readme"><b>Documentation</b></a> • <a href="https://agenta.ai?utm_source=github&utm_medium=referral&utm_campaign=readme"><b>Website</b></a> • <a href="https://cloud.agenta.ai?utm_source=github&utm_medium=referral&utm_campaign=readme"><b>Agenta Cloud</b></a> </h3>

What is Agenta?

Agenta is a platform for building production-grade LLM applications. It helps engineering and product teams create reliable LLM apps faster through integrated prompt management, evaluation, and observability.

Core Features

🧪 Prompt Management & Prompt Engineering

Collaborate with Subject Matter Experts (SMEs) on prompt engineering and make sure nothing breaks in production.

Interactive LLM Playground: Compare prompts side by side against your test cases
Multi-Model Support: Experiment with 50+ LLM models or bring-your-own models
Version Control: Version prompts and configurations with branching and environments
Complex Configurations: Enable SMEs to collaborate on complex configuration schemas beyond simple prompts

Explore prompt management →

📊 LLM Evaluation

Evaluate your LLM applications systematically with both human and automated feedback.

Flexible Testsets: Create testcases from production data, playground experiments, or upload CSVs
Pre-built and Custom Evaluators: Use LLM-as-judge, one of our 20+ pre-built evaluators, or your custom evaluators
UI and API Access: Run evaluations via UI (for SMEs) or programmatically (for engineers)
Human Feedback Integration: Collect and incorporate expert annotations

Explore evaluation frameworks →

📡 LLM Observability

Get visibility into your LLM applications in production.

Cost & Performance Tracking: Monitor spending, latency, and usage patterns
LLM Tracing: Debug complex workflows with detailed traces
Open Standards: OpenTelemetry native tracing compatible with OpenLLMetry, and OpenInference
Integrations: Comes with pre-built integrations for most models and frameworks

Learn about observability →

📸 Screenshots

🚀 Getting Started

Agenta Cloud (Recommended):

The easiest way to get started is through Agenta Cloud. Free tier available with no credit card required.

Self-hosting Agenta

Clone Agenta:

git clone https://github.com/Agenta-AI/agenta && cd agenta

Copy configuration:

Before starting the services, create the environment file from the example:

cp hosting/docker-compose/oss/env.oss.gh.example hosting/docker-compose/oss/.env.oss.gh

Start Agenta services:

docker compose -f hosting/docker-compose/oss/docker-compose.gh.yml --env-file hosting/docker-compose/oss/.env.oss.gh --profile with-web --profile with-traefik up -d

Access Agenta at http://localhost.

For deploying on a remote host, or using different ports refer to our self-hosting and remote deployment documentation.

💬 Community

Find help, explore resources, or get involved:

🧰 Support

📚 Documentation – Full guides and API reference
📋 Changelog – Track recent updates
💬 Slack Community – Ask questions and get support

🤝 Contribute

We welcome contributions of all kinds, from filing issues and sharing ideas to improving the codebase. Check out our CONTRIBUTING.md and:

🐛 Report bugs – Help us by reporting problems you encounter
💡 Share ideas and feedback – Suggest features or vote on ideas
🔧 Contribute to the codebase – Read the guide and open a pull request

⭐ Star Agenta

Consider giving us a star! It helps us grow our community and gets Agenta in front of more developers. </br> </br>

Contributors ✨

<!-- ALL-CONTRIBUTORS-BADGE:START -

Agenta

Install / Use

README