Browse the directory

A source-backed collection for building repeatable LLM eval and prompt testing workflows with open-source tools: prompt regression tests, RAG and agent metrics, human review datasets, traces, prompt optimization, and release gates.

Open-source, self-hostable AI engine that runs LLMs, vision, voice, image, and video models on your own hardware behind one API, with drop-in OpenAI, Anthropic, and ElevenLabs API compatibility, composable on-demand backends, and no GPU required.

Open-source suite of development tools from Microsoft for building LLM applications end to end — create executable flows that link LLMs, prompts, Python, and tools, trace and debug them, evaluate quality against datasets in CI/CD, and deploy to a serving platform.

Open-source all-in-one AI framework for semantic search, LLM orchestration, and language-model workflows, built around an embeddings database that unions sparse and dense vector indexes, graph networks, and relational databases, with pipelines, workflows, agents, and web and MCP APIs.

Open-source library for fast, memory-efficient fine-tuning, reinforcement learning, and training of open LLMs — train 500+ models up to 2x faster with up to 70% less VRAM and no accuracy loss, with LoRA/QLoRA support and export to GGUF, safetensors, vLLM, and Ollama.

Open-source domain-specific language from BoundaryML for writing typed LLM functions with structured inputs and outputs, a VSCode playground, and generated clients you can call from Python, TypeScript, Go, and more.

Open-source AI memory platform that gives agents persistent long-term memory by ingesting data in any format and building a self-hosted knowledge graph, combining vector embeddings, graph reasoning, and ontology generation for meaning-based and relationship-based retrieval.

Open-source, LLM-friendly Python web crawler and scraper that turns web pages into clean, LLM-ready Markdown for RAG, agents, and data pipelines, with an async browser pool, caching, structured extraction, and adaptive deep crawling.

Open-source toolkit from the Docling project for parsing PDF, DOCX, PPTX, XLSX, HTML, images, and more into a unified DoclingDocument, with advanced PDF understanding, OCR, and exports to Markdown and JSON for gen AI and RAG workflows.

Open-source observability platform purpose-built for AI agents, with OpenTelemetry-native tracing, plain-English signals, an evals SDK and CLI, SQL dashboards, dataset annotation, and MCP/CLI access, self-hostable with Apache-2.0 SDKs for Python and TypeScript.

Open-source memory layer for AI agents and assistants that extracts, stores, and retrieves user, session, and agent memories so applications can personalize and remember across interactions, with Python and TypeScript SDKs and pluggable vector, graph, and key-value stores.

Open-source AI gateway from Portkey for routing to 1600+ LLMs through one OpenAI-compatible API, with automatic retries, fallbacks, load balancing, conditional routing, guardrails, caching, and observability, self-hostable via npx, Docker, or edge deployments.

Open-source visual AI programming environment from Ironclad for building, debugging, and embedding complex LLM agents and prompt-chaining graphs, with a desktop app and a TypeScript library.

Open-source Python AgentOS and multi-agent framework, evolved from AutoGen, for building conversable agents, group chats, swarms, human-in-the-loop workflows, tool use, RAG, code execution, and provider-backed agent systems.

Apache-2.0 AI-first IAM, auth server, and agent/MCP gateway with a web UI, OAuth/OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, MFA, OpenClaw/A2A positioning, an `/api/mcp` endpoint for Casdoor administration tools, and configurable upstream MCP server proxying with tool allowlists and bearer-token forwarding.

Open-source infrastructure for securely running AI-generated code in isolated sandboxes that start in milliseconds, with SDKs for Python, TypeScript, and other languages, persistent snapshots, and an optional managed cloud.

Open-source infrastructure for running AI-generated code in secure, isolated cloud sandboxes, with Python and JavaScript SDKs, a Code Interpreter package, and self-hosting options.

Open-source, extensible AI agent that goes beyond code suggestions to install, execute, edit, and test with any LLM, available as a desktop app, CLI, and API with 70+ MCP extensions.

Open-source project behind CodeLayer, an IDE for orchestrating AI coding agents built on Claude Code, with keyboard-first workflows, team context engineering, and parallel Claude Code sessions across worktrees and cloud workers.

Open-source platform that runs Claude agents in isolated per-session containers, connects them to messaging channels, keeps per-agent memory and scheduled tasks, and routes credentials through a vault so keys never enter containers.

Lightweight, open-source coding agent from OpenAI that runs in your terminal, edits and runs code locally with configurable sandbox and approval modes, and authenticates with a ChatGPT plan or API key.

Open-source framework from OpenAI for evaluating LLM and agent behavior with reusable eval definitions, grading logic, datasets, and regression workflows.

Open-source configuration framework that enhances Claude Code with slash commands, specialized agents, behavioral modes, and MCP server integrations for a more structured development workflow.

Open-source LLMOps platform for prompt management, prompt versioning, evaluation, and observability across LLM applications.

Open-source observability platform and SDK for tracing, debugging, replaying, and cost-monitoring AI agent and LLM application runs.

Open-source secret scanner for finding passwords, API keys, tokens, and other credentials in git history, files, directories, and stdin.

Open-source Python framework for adding input and output guards, validators, structured generation, and policy checks to LLM applications.

Open-source data labeling, annotation, and human-in-the-loop AI evaluation platform for text, images, audio, video, time series, and multimodal datasets.

Open-source AI gateway and Python SDK for routing LLM calls through a unified OpenAI-compatible interface.

Open-source evaluation framework for testing RAG systems, prompts, agents, workflows, and other LLM application behavior.