SkillAgentSearch skills...

langsmith-tracing

LangSmith tracing and debugging setup for LLM applications. Configure observability, capture traces, and enable debugging for LangChain/LangGraph agents.

Install / Use

npx skills add a5c-ai/babysitter --skill langsmith-tracing

Installs into whichever agent you are using.

About this skill
📄

SKILL.md

Installable skill definition

Quality Score

89/100

Category

Automation

Supported Platforms

Universal

Our assessment of langsmith-tracing

langsmith-tracing scores 89/100 on our quality scale, 1370th of 2,790 Automation skills we index (top 50%).

Its SKILL.md is 4.9 KB long, well organised into 22 sections with 4 code examples: a solid amount of guidance for an agent.

With 1,809 GitHub stars, it is one of the more widely adopted skills in the catalogue.

Substance
26/30
Structure
20/20
Description
15/15
Adoption
14/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated about 2 months ago, so langsmith-tracing is actively maintained.
  • Our last check on 2026-10-31 found the source still online.
  • It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
  • Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

Safety scan

No issues found

Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful.

AI review by kimi-k2.7-code on 2026-09-30. Automated pattern scan on 2026-09-30. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.

langsmith-tracing compared with similar skills

All 4 of these similar skills score higher than langsmith-tracing; compare them before choosing.

SkillScoreStarsUpdatedFormat
langsmith-tracing (this skill)by a5c-ai891.8k2mo agoSKILL.md
Agent-Reachby Panniantong100112.3k8d agoCLAUDE.md
rufloby ruvnet10081.9ktodayCLAUDE.md
Claude-Code-Game-Studiosby Donchitos10039.7k7d agoCLAUDE.md
Scraplingby D4Vinci100103.6k2d agoMCP Server

Frequently asked questions

How do I install langsmith-tracing?
Run npx skills add a5c-ai/babysitter --skill langsmith-tracing. The install tabs above show the steps for each supported agent.
Which AI agents does langsmith-tracing work with?
It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
Is langsmith-tracing safe to use?
Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands. An AI review of the same text found nothing harmful. It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is langsmith-tracing still maintained?
The repository was last updated about 2 months ago, so langsmith-tracing is actively maintained.

name: langsmith-tracing description: LangSmith tracing and debugging setup for LLM applications. Configure observability, capture traces, and enable debugging for LangChain/LangGraph agents. allowed-tools: Read, Grep, Write, Edit, Bash, Glob, WebFetch graph: domains: [domain:software-engineering] specializations: [specialization:ai-agents-conversational] skillAreas: [skill-area:agent-debugging-logging, skill-area:agent-simulation-testing] roles: [role:ml-engineer, role:backend-engineer] workflows: [workflow:ml-model-lifecycle, workflow:feature-development]


langsmith-tracing

Configure LangSmith observability and tracing for LLM applications built with LangChain and LangGraph frameworks.

Overview

LangSmith is the managed observability suite by LangChain that provides:

  • Dashboards and alerting for LLM applications
  • Human-in-the-loop evaluation capabilities
  • Deep LangChain/LangGraph integration
  • Run Tree model for nested traces
  • MCP connectivity to Claude, VSCode

Capabilities

Core Tracing Setup

  • Initialize LangSmith client and API configuration
  • Configure project/workspace settings
  • Set up trace collection and sampling
  • Enable debug logging for agent execution

Integration Patterns

  • LangChain chain tracing with automatic instrumentation
  • LangGraph workflow state tracking
  • Custom span creation for non-LangChain code
  • Parent-child trace relationships

Debugging Features

  • Fetch execution traces for analysis
  • Query run history and metadata
  • Export traces for offline analysis
  • Compare runs across different versions

Usage

Environment Setup

# Set required environment variables
export LANGCHAIN_TRACING_V2=true
export LANGCHAIN_API_KEY=<your-api-key>
export LANGCHAIN_PROJECT=<project-name>

Python Integration

from langsmith import Client, traceable
from langchain.callbacks.tracers import LangChainTracer

# Initialize client
client = Client()

# Use @traceable decorator for custom functions
@traceable(name="custom_operation")
def my_function(input_data):
    # Your logic here
    return result

# Initialize tracer for LangChain
tracer = LangChainTracer(project_name="my-project")

# Use with LangChain chains
chain.invoke(input, config={"callbacks": [tracer]})

Trace Retrieval

# Fetch traces from LangSmith
runs = client.list_runs(
    project_name="my-project",
    start_time=datetime.now() - timedelta(hours=24),
    execution_order=1,  # Root runs only
    error=False,  # Successful runs only
)

for run in runs:
    print(f"Run ID: {run.id}")
    print(f"Latency: {run.latency_p99}")
    print(f"Tokens: {run.total_tokens}")

Task Definition

When used in a babysitter process, this skill produces:

const langsmithTracingTask = defineTask({
  name: 'langsmith-tracing-setup',
  description: 'Configure LangSmith tracing for the application',

  inputs: {
    projectName: { type: 'string', required: true },
    apiKeyEnvVar: { type: 'string', default: 'LANGCHAIN_API_KEY' },
    samplingRate: { type: 'number', default: 1.0 },
    enableDebug: { type: 'boolean', default: false }
  },

  outputs: {
    configured: { type: 'boolean' },
    projectUrl: { type: 'string' },
    artifacts: { type: 'array' }
  },

  async run(inputs, taskCtx) {
    return {
      kind: 'skill',
      title: `Configure LangSmith tracing for ${inputs.projectName}`,
      skill: {
        name: 'langsmith-tracing',
        context: {
          projectName: inputs.projectName,
          apiKeyEnvVar: inpu…[redacted],
          samplingRate: inputs.samplingRate,
          enableDebug: inputs.enableDebug,
          instructions: [
            'Verify LangSmith API credentials are available',
            'Create or validate project configuration',
            'Set up tracing instrumentation in codebase',
            'Configure sampling rate and debug settings',
            'Verify traces are being captured correctly'
          ]
        }
      },
      io: {
        inputJsonPath: `tasks/${taskCtx.effectId}/input.json`,
        outputJsonPath: `tasks/${taskCtx.effectId}/result.json`
      }
    };
  }
});

Applicable Processes

  • llm-observability-monitoring
  • agent-evaluation-framework
  • react-agent-implementation
  • conversation-quality-testing
  • regression-testing-agent

External Dependencies

  • LangSmith account and API key
  • LangChain Python library
  • langsmith Python package

References

Related Skills

  • SK-OBS-002 langfuse-integration
  • SK-OBS-003 phoenix-arize-setup
  • SK-OBS-004 opentelemetry-llm

Related Agents

  • AG-OPS-004 observability-engineer
  • AG-SAF-004 agent-evaluator

Related Skills

View on GitHub
GitHub Stars1.8k
CategoryAutomation
Updated2mo ago
Forks110

Languages

JavaScript

Trust signals

100/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

No cautions