Browse the directory

Open-source observability platform purpose-built for AI agents, with OpenTelemetry-native tracing, plain-English signals, an evals SDK and CLI, SQL dashboards, dataset annotation, and MCP/CLI access, self-hostable with Apache-2.0 SDKs for Python and TypeScript.

Open-source agent engineering framework for building LLM applications with agents, model abstractions, tools, middleware, RAG, streaming, memory, MCP adapters, LangGraph-backed execution, and LangSmith observability hooks.

MIT-licensed Go implementation of the Model Context Protocol for building MCP servers and clients with tools, resources, prompts, stdio, SSE, Streamable HTTP, hooks, session management, validation, sampling, roots, and tracing.

Official JavaScript and TypeScript framework for building multi-agent workflows with agents, tools, handoffs, guardrails, sessions, tracing, realtime voice agents, MCP tools, hosted tools, and sandbox agents.

Official Python framework for building multi-agent workflows with agents, tools, handoffs, guardrails, sessions, tracing, realtime voice agents, MCP tools, hosted tools, human-in-the-loop flows, and sandbox agents.

Open-source MCP gateway, registry, and proxy from IBM that federates MCP servers, A2A agents, REST APIs, and gRPC services behind centralized discovery, governance, authentication, observability, and admin controls.

Source-backed specialist agent for designing and reviewing production OpenAI Agents SDK workflows, including agents, runners, tools, handoffs, guardrails, sessions, tracing, MCP integrations, sandbox agents, and deployment safety.

Open-source Python framework for unit-testing LLM applications, agents, RAG pipelines, metrics, regression suites, and traces.

Open-source LLM engineering platform for tracing, prompt management, evaluation, metrics, and observability.

ByteRay MCP provides AI-augmented binary vulnerability analysis with taint tracing and zero-day hunting tools.

Transform Claude into a Playwright specialist with deep knowledge of browser automation, resilient locators, fixtures, tracing, and CI-friendly end-to-end testing.

Open-source suite of development tools from Microsoft for building LLM applications end to end — create executable flows that link LLMs, prompts, Python, and tools, trace and debug them, evaluate quality against datasets in CI/CD, and deploy to a serving platform.

Inspect LLM traces and spans, manage prompts, explore datasets, and review evaluation experiments from Claude — with the official Arize Phoenix MCP server, built into the open-source Phoenix AI observability platform.

Connect Claude to LangSmith — retrieve conversation threads and traces, fetch and push prompts, browse evaluation datasets and experiments, and access billing usage — with the official LangSmith Model Context Protocol server from LangChain.

Analyze distributed traces and LLM observability data from Claude — search traces and spans, find errors, list services, analyze LLM token usage, identify slow LLM operations, and discover AI model usage patterns — with the OpenTelemetry MCP server supporting Jaeger, Grafana Tempo, and Traceloop backends.

Debug, evaluate, and monitor LLM applications from Claude — read traces and spans, score outputs, save prompts, run evaluation experiments, and query project metrics — with the official Opik MCP server by Comet.

Open-source observability platform and SDK for tracing, debugging, replaying, and cost-monitoring AI agent and LLM application runs.

Open-source evaluation and tracing framework for measuring AI agents, RAG systems, LLM apps, retrieval quality, feedback metrics, and trace-level regressions.

Connect Claude to Honeycomb observability data — query traces and events, investigate alerts, manage boards and triggers, create SLOs, and cross-reference production behavior with your codebase — with the official Honeycomb hosted MCP server.

Connect Claude Code, Cursor, Copilot, Windsurf, and other MCP clients to the public Langfuse documentation MCP server for tracing, prompt management, evaluation, and agent observability implementation help.

Query OpenTelemetry traces and metrics, manage dashboards, analyze distributed traces, and investigate exceptions from Claude — with the official Pydantic Logfire remote MCP server hosted at logfire-us.pydantic.dev/mcp.

Source-backed guide for converting OpenAI Agents SDK traces into regression eval cases, trace grades, tool-call assertions, and release checks for agentic workflows.

A practical guide to instrumenting LLM and agent applications with traces, metrics, logs, GenAI semantic attributes, sampling, and privacy-aware redaction so teams can debug model calls, tool use, retries, and cost.

Open-source AI engineering platform for tracing, evaluating, prompt-managing, and deploying agents, LLM applications, and ML models.

Open-source observability and evaluation tooling for LLM applications, traces, datasets, and experiments.

Observability, evaluation, tracing, and testing platform for LLM applications and agent workflows.

High-performance MCP server that indexes codebases into a persistent knowledge graph for structural search, call tracing, architecture summaries, dead-code detection, and cross-repo analysis.