LiteLLM
Open-source AI gateway and Python SDK for routing LLM calls through a unified OpenAI-compatible interface.
Open the source and read safety notes before installing.
Safety notes
- LiteLLM can proxy requests to multiple model providers, so route and fallback behavior should be reviewed before production use.
- Gateway deployments can expose model access to teams or applications; configure authentication, budgets, rate limits, and network access intentionally.
- Avoid logging sensitive prompt, response, or credential material when enabling debugging, observability, or admin features.
Privacy notes
- Prompts and responses pass through the LiteLLM process and then to the selected upstream model provider.
- Gateway logs, spend tracking, and observability integrations may retain request metadata or payload excerpts depending on configuration.
- Self-hosted deployments still depend on the privacy terms of each configured model provider.
Prerequisites
- Python or Docker for local/self-hosted use.
- Provider credentials for the model backends you choose to route through LiteLLM.
- A reviewed gateway configuration before sharing it with teammates or production clients.
Schema details
- Install type
- copy
- Troubleshooting
- No
- Scope
- Source repo
- Pricing
- open-source
- Disclosure
- editorial
- Application category
- DeveloperApplication
- Operating system
- macOS, Windows, Linux, Self-hosted
Full copyable content
## Editorial notes
LiteLLM is a strong fit for Claude and agent workflows that need one OpenAI-compatible gateway in front of multiple model providers. The official docs describe both the Python SDK and the self-hosted proxy, including routing, load balancing, virtual keys, spend tracking, guardrails, observability, and an admin UI.
## Source notes
- The official documentation describes LiteLLM as an open-source library with a unified interface for 100+ LLMs and a self-hosted LLM gateway/proxy.
- The GitHub README describes LiteLLM as an open-source AI gateway for 100+ LLMs with OpenAI-format calls.
- The PyPI package is published as `litellm` for Python SDK and proxy installation paths.
## Duplicate check
Checked current `content/tools/`, open pull requests, and the repository for `LiteLLM`, `BerriAI`, `llm gateway`, `model router`, and `openai compatible proxy`. No existing LiteLLM listing or open duplicate PR was found.
## Disclosure
Editorial listing. No paid placement or affiliate link is used.About this resource
Editorial notes
LiteLLM is a strong fit for Claude and agent workflows that need one OpenAI-compatible gateway in front of multiple model providers. The official docs describe both the Python SDK and the self-hosted proxy, including routing, load balancing, virtual keys, spend tracking, guardrails, observability, and an admin UI.
Source notes
- The official documentation describes LiteLLM as an open-source library with a unified interface for 100+ LLMs and a self-hosted LLM gateway/proxy.
- The GitHub README describes LiteLLM as an open-source AI gateway for 100+ LLMs with OpenAI-format calls.
- The PyPI package is published as
litellmfor Python SDK and proxy installation paths.
Duplicate check
Checked current content/tools/, open pull requests, and the repository for LiteLLM, BerriAI, llm gateway, model router, and openai compatible proxy. No existing LiteLLM listing or open duplicate PR was found.
Disclosure
Editorial listing. No paid placement or affiliate link is used.
Source citations
Signals
Loading live community signals…
A short, calm digest of reviewed Claude resources. Unsubscribe any time.