Langtrace

<div align="center"> <h1> <img src="https://github.com/Scale3-Labs/langtrace/assets/105607645/6825158c-39bb-4270-b1f9-446c36c066ee" alt="Langtrace" width="400"/> <br/> <a href="https://www.langtrace.ai">Langtrace</a> </h1> <h3>Open Source Observability for LLM Applications</h3>

</div>

---

📚 Table of Contents

• ✨ Features
• 🚀 Quick Start
• 🔗 Integrations
• 🌐 Getting Started
• 🏠 Self Hosting
• 📐 Architecture
• 🤝 Contributing
• 🔒 Security
• ❓ FAQ
• 👥 Contributors
• 📜 License

Langtrace is an open source observability software which lets you capture, debug and analyze traces and metrics from all your applications that leverages LLM APIs, Vector Databases and LLM based Frameworks.

✨ Features

• 📊 Open Telemetry Support: Built on OTEL standards for comprehensive tracing
• 🔄 Real-time Monitoring: Track LLM API calls, vector operations, and framework usage
• 🎯 Performance Insights: Analyze latency, costs, and usage patterns
• 🔍 Debug Tools: Trace and debug your LLM application workflows
• 📈 Analytics: Get detailed metrics and visualizations
• 🏠 Self-hosting Option: Deploy on your own infrastructure

🚀 Quick Start

# For TypeScript/JavaScript
npm i @langtrase/typescript-sdk

# For Python
pip install langtrace-python-sdk

Initialize in your code:

// TypeScript
import * as Langtrace from '@langtrase/typescript-sdk'
Langtrace.init({ api_key: '<your_api_key>' }) // Get your API key at langtrace.ai

# Python
from langtrace_python_sdk import langtrace
langtrace.init(api_key='<your_api_key>') # Get your API key at langtrace.ai

For detailed setup instructions, see Getting Started.

📊 Open Telemetry Support

The traces generated by Langtrace adhere to Open Telemetry Standards(OTEL). We are developing semantic conventions for the traces generated by this project. You can checkout the current definitions in this repository. Note: This is an ongoing development and we encourage you to get involved and welcome your feedback.

---

📦 SDK Repositories

• Langtrace Typescript SDK
• Langtrace Python SDK
• Semantic Span Attributes

---

🚀 Getting Started

Langtrace Cloud ☁️

To use the managed SaaS version of Langtrace, follow the steps below:

1. Sign up by going to this link.
2. Create a new Project after signing up. Projects are containers for storing traces and metrics generated by your application. If you have only one application, creating 1 project will do.
3. Generate an API key by going inside the project.
4. In your application, install the Langtrace SDK and initialize it with the API key you generated in the step 3.
5. The code for installing and setting up the SDK is shown below:

If your application is built using typescript/javascript

npm i @langtrase/typescript-sdk

import * as Langtrace from '@langtrase/typescript-sdk' // Must precede any llm module imports
Langtrace.init({ api_key: <your_api_key> })

OR

import * as Langtrace from "@langtrase/typescript-sdk"; // Must precede any llm module imports
LangTrace.init(); // LANGTRACE_API_KEY as an ENVIRONMENT variable

If your application is built using python

pip install langtrace-python-sdk

from langtrace_python_sdk import langtrace
langtrace.init(api_key=<your_api_key>)

OR

from langtrace_python_sdk import langtrace
langtrace.init() # LANGTRACE_API_KEY as an ENVIRONMENT variable

🏠 Langtrace self hosted

To run the Langtrace locally, you have to run three services:

• Next.js app
• Postgres database
• Clickhouse database

[!IMPORTANT] Checkout our documentation for various deployment options and configurations.

Requirements:

• Docker
• Docker Compose

The .env file

Feel free to modify the .env file to suit your needs.

Starting the servers

docker compose up

The application will be available at http://localhost:3000.

Take down the setup

To delete containers and volumes

docker compose down -v

-v flag is used to delete volumes

Telemetry

Langtrace does NOT collect any Telemetry if you are self hosting the OSS client. None of your data leaves your servers.

---

🔗 Supported Integrations

Langtrace automatically captures traces from the following vendors and frameworks:

LLM Providers

| Provider | TypeScript SDK | Python SDK | |----------|:-------------:|:----------:| | OpenAI | ✅ | ✅ | | Anthropic | ✅ | ✅ | | Azure OpenAI | ✅ | ✅ | | Cohere | ✅ | ✅ | | DeepSeek | ✅ | ✅ | | xAI | ✅ | ✅ | | Groq | ✅ | ✅ | | Perplexity | ✅ | ✅ | | Gemini | ✅ | ✅ | | AWS Bedrock | ✅ | ✅ | | Mistral | ❌ | ✅ |

LLM Frameworks

| Framework | TypeScript SDK | Python SDK | |-----------|:-------------:|:----------:| | Langchain | ❌ | ✅ | | LlamaIndex | ✅ | ✅ | | Langgraph | ❌ | ✅ | | LiteLLM | ❌ | ✅ | | DSPy | ❌ | ✅ | | CrewAI | ❌ | ✅ | | Ollama | ❌ | ✅ | | VertexAI | ✅ | ✅ | | Vercel AI | ✅ | ❌ | | GuardrailsAI | ❌ | ✅ | | Arch | ❌ | ✅ | | Graphlit | ❌ | ✅ | | Agno | ❌ | ✅ | | Phidata | ❌ | ✅ | | Cleanlab | ❌ | ✅ |

Vector Databases

| Database | TypeScript SDK | Python SDK | |----------|:-------------:|:----------:| | Pinecone | ✅ | ✅ | | ChromaDB | ✅ | ✅ | | QDrant | ✅ | ✅ | | Weaviate | ✅ | ✅ | | PGVector | ✅ | ✅ (SQLAlchemy) | | MongoDB | ❌ | ✅ | | Milvus | ❌ | ✅ |

---

📐 Langtrace System Architecture

---

💡 Feature Requests and Issues

• To request for features, head over here to start a discussion.
• To raise an issue, head over here and create an issue.

---

🤝 Contributions

We welcome contributions to this project. To get started, fork this repository and start developing. To get involved, join our Slack workspace.

---

🌟 Langtrace Star History

---

🔒Security

To report security vulnerabilities, email us at security@scale3labs.com. You can read more on security here.

---

📜 License

• Langtrace application(this repository) is licensed under the AGPL 3.0 License. You can read about this license here.
• Langtrace SDKs are licensed under the Apache 2.0 License. You can read about this license here.

👥 Contributors

<div align="center"> <table> <tr> <td align="center"><a href="https://github.com/karthikscale3"><img src="https://github.com/karthikscale3.png" width="100px;" alt="karthikscale3"/><br />_{<b>karthikscale3</b>}</a></td> <td align="center"><a href="https://github.com/dylanzuber-scale3"><img src="https://github.com/dylanzuber-scale3.png" width="100px;" alt="dylanzuber-scale3"/><br />_{<b>dylanzuber-scale3</b>}</a></td> <td align="center"><a href="https://github.com/darshit-s3"><img src="https://github.com/darshit-s3.png" width="100px;" alt="darshit-s3"/><br />_{<b>darshit-s3</b>}</a></td> <td align="center"><a href="https://github.com/rohit-kadhe"><img src="https://github.com/rohit-kadhe.png" width="100px;" alt="rohit-kadhe"/><br />_{<b>rohit-kadhe</b>}</a></td> </tr> <tr> <td align="center"><a href="https://github.com/yemiadej"><img src="https://github.com/yemiadej.png" width="100px;