Langfuse

<img width="4856" height="1000" alt="github-banner" src="https://github.com/user-attachments/assets/6f435ef3-1194-4e26-87af-aa13826bbb5f" /> <div align="center"> <div> <h3> <a href="https://langfuse.com/blog/2025-06-04-open-sourcing-langfuse-product"> <strong>Langfuse Is Doubling Down On Open Source</strong> </a> <br> <br> <a href="https://cloud.langfuse.com"> <strong>Langfuse Cloud</strong> </a> · <a href="https://langfuse.com/docs/deployment/self-host"> <strong>Self Host</strong> </a> · <a href="https://langfuse.com/demo"> <strong>Demo</strong> </a> </h3> </div> <div> <a href="https://langfuse.com/docs"><strong>Docs</strong></a> · <a href="https://langfuse.com/issues"><strong>Report Bug</strong></a> · <a href="https://langfuse.com/ideas"><strong>Feature Request</strong></a> · <a href="https://langfuse.com/changelog"><strong>Changelog</strong></a> · <a href="https://langfuse.com/roadmap"><strong>Roadmap</strong></a> · </div> <br/> <span>Langfuse uses <a href="https://github.com/orgs/langfuse/discussions"><strong>GitHub Discussions</strong></a> for Support and Feature Requests.</span> <br/> <span><b>We're hiring.</b> <a href="https://langfuse.com/careers"><strong>Join us</strong></a> in product engineering and technical go-to-market roles.</span> <br/> <br/> <div> </div> </div> <p align="center"> <a href="https://github.com/langfuse/langfuse/blob/main/LICENSE"> <img src="https://img.shields.io/badge/License-MIT-E11311.svg" alt="MIT License"> </a> <a href="https://www.ycombinator.com/companies/langfuse"><img src="https://img.shields.io/badge/Y%20Combinator-W23-orange" alt="Y Combinator W23"></a> <a href="https://hub.docker.com/u/langfuse" target="_blank"> <img alt="Docker Pulls" src="https://img.shields.io/docker/pulls/langfuse/langfuse?labelColor=%20%23FDB062&logo=Docker&labelColor=%20%23528bff"></a> <a href="https://pypi.python.org/pypi/langfuse"><img src="https://img.shields.io/pypi/dm/langfuse?logo=python&logoColor=white&label=pypi%20langfuse&color=blue" alt="langfuse Python package on PyPi"></a> <a href="https://www.npmjs.com/package/langfuse"><img src="https://img.shields.io/npm/dm/langfuse?logo=npm&logoColor=white&label=npm%20langfuse&color=blue" alt="langfuse npm package"></a> <br/> <a href="https://discord.com/invite/7NXusRtqYU" target="_blank"> <img src="https://img.shields.io/discord/1111061815649124414?logo=discord&labelColor=%20%235462eb&logoColor=%20%23f5f5f5&color=%20%235462eb" alt="chat on Discord"></a> <a href="https://twitter.com/intent/follow?screen_name=langfuse" target="_blank"> <img src="https://img.shields.io/twitter/follow/langfuse?logo=X&color=%20%23f5f5f5" alt="follow on X(Twitter)"></a> <a href="https://www.linkedin.com/company/langfuse/" target="_blank"> <img src="https://custom-icon-badges.demolab.com/badge/LinkedIn-0A66C2?logo=linkedin-white&logoColor=fff" alt="follow on LinkedIn"></a> <a href="https://github.com/langfuse/langfuse/graphs/commit-activity" target="_blank"> <img alt="Commits last month" src="https://img.shields.io/github/commit-activity/m/langfuse/langfuse?labelColor=%20%2332b583&color=%20%2312b76a"></a> <a href="https://github.com/langfuse/langfuse/" target="_blank"> <img alt="Issues closed" src="https://img.shields.io/github/issues-search?query=repo%3Alangfuse%2Flangfuse%20is%3Aclosed&label=issues%20closed&labelColor=%20%237d89b0&color=%20%235d6b98"></a> <a href="https://github.com/langfuse/langfuse/discussions/" target="_blank"> <img alt="Discussion posts" src="https://img.shields.io/github/discussions/langfuse/langfuse?labelColor=%20%239b8afb&color=%20%237a5af8"></a> <a href="https://deepwiki.com/langfuse/langfuse" target="_blank"> <img alt="Ask DeepWiki" src="https://deepwiki.com/badge.svg"></a> </p> <p align="center"> <a href="./README.md"><img alt="README in English" src="https://img.shields.io/badge/English-d9d9d9"></a> <a href="./README.cn.md"><img alt="简体中文版自述文件" src="https://img.shields.io/badge/简体中文-d9d9d9"></a> <a href="./README.ja.md"><img alt="日本語のREADME" src="https://img.shields.io/badge/日本語-d9d9d9"></a> <a href="./README.kr.md"><img alt="README in Korean" src="https://img.shields.io/badge/한국어-d9d9d9"></a> </p> <p align="center"> <a href="https://github.com/ClickHouse/ClickHouse"><strong>Proudly made with ClickHouse open source database</strong></a> </p>

Langfuse is an open source LLM engineering platform. It helps teams collaboratively develop, monitor, evaluate, and debug AI applications. Langfuse can be self-hosted in minutes and is battle-tested.

✨ Core Features

<img width="4856" height="1944" alt="Langfuse Overview" src="https://github.com/user-attachments/assets/5dac68ef-d546-49fb-b06f-cfafc19282e3" />

• LLM Application Observability: Instrument your app and start ingesting traces to Langfuse, thereby tracking LLM calls and other relevant logic in your app such as retrieval, embedding, or agent actions. Inspect and debug complex logs and user sessions. Try the interactive demo to see this in action.

• Prompt Management helps you centrally manage, version control, and collaboratively iterate on your prompts. Thanks to strong caching on server and client side, you can iterate on prompts without adding latency to your application.

• Evaluations are key to the LLM application development workflow, and Langfuse adapts to your needs. It supports LLM-as-a-judge, user feedback collection, manual labeling, and custom evaluation pipelines via APIs/SDKs.

• Datasets enable test sets and benchmarks for evaluating your LLM application. They support continuous improvement, pre-deployment testing, structured experiments, flexible evaluation, and seamless integration with frameworks like LangChain and LlamaIndex.

• LLM Playground is a tool for testing and iterating on your prompts and model configurations, shortening the feedback loop and accelerating development. When you see a bad result in tracing, you can directly jump to the playground to iterate on it.

• Comprehensive API: Langfuse is frequently used to power bespoke LLMOps workflows while using the building blocks provided by Langfuse via the API. OpenAPI spec, Postman collection, and typed SDKs for Python, JS/TS are available.

📦 Deploy Langfuse

<img width="4856" height="1322" alt="Langfuse Deployment Options" src="https://github.com/user-attachments/assets/98f020c7-7a20-4264-a201-65c41a52a5d5" />

Langfuse Cloud

Managed deployment by the Langfuse team, generous free-tier, no credit card required.

<div align="center"> <a href="https://cloud.langfuse.com" target="_blank"> <img alt="Static Badge" src="https://img.shields.io/badge/»%20Sign%20up%20for%20Langfuse%20Cloud-8A2BE2?&color=orange"> </a> </div>

Self-Host Langfuse

Run Langfuse on your own infrastructure:

• Local (docker compose): Run Langfuse on your own machine in 5 minutes using Docker Compose.

  # Get a copy of the latest Langfuse repository
  git clone https://github.com/langfuse/langfuse.git
  cd langfuse
  
  # Run the langfuse docker compose
  docker compose up
  

• VM: Run Langfuse on a single Virtual Machine using Docker Compose.

• Kubernetes (Helm): Run Langfuse on a Kubernetes cluster using Helm. This is the preferred production deployment.

• Terraform Templates: AWS, Azure, GCP

See self-hosting documentation to learn more about architecture and configuration options.

🔌 Integrations

<img width="4856" height="1322" alt="github-integrations" src="https://github.com/user-attachments/assets/e41ea0fb-742d-41ce-bf94-1d4fb95750cd" />

Main Integrations:

| Integration | Supports | Description | | ---------------------------------------------------------------------------- | -------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------ | | SDK | Python, JS/TS | Manual instrumentation using the SDKs for full flexibility. | | OpenAI | Python, JS/TS | Automated instrumentation using drop-in replacement of OpenAI SDK. | | Langchain | Python, JS/TS | Automated instrumentation by passing callback handler to Langchain application. | | LlamaIndex | Python