Integrations
This section covers integrations with various tools and services that can be used with LiteLLM (either Proxy or SDK).
Observability
Track, debug, and analyze LLM calls with observability platforms.
🪢
Langfuse
LLM observability and analytics.
🐶
Datadog
Metrics, traces, and dashboards.
📡
OpenTelemetry
Vendor-neutral tracing.
🔗
LangSmith
LLM debugging and evaluation.
🔥
Arize / Phoenix
ML observability and evaluation.
🌀
Helicone
LLM request logging and analytics.
📊
MLflow
Experiment tracking.
🏋️
Weights & Biases
ML experiment tracking.
📉
PostHog
Product analytics.
View all observability integrations →
Alerting & Monitoring
Set up alerts, metrics collection, and infrastructure monitoring.
📈
Prometheus
Metrics collection and monitoring.
🚨
PagerDuty
Incident response and alerting.
🔔
Alerting
Slack, Teams, and webhook alerts.
🔍
Pyroscope
Continuous profiling.
Guardrail Providers
Add safety and content filtering to LLM calls.
🛡️
Lakera AI
Prompt injection detection.
☁️
Azure Content Safety
Content moderation.
🛏️
Bedrock Guardrails
AWS Bedrock safety.
🤖
OpenAI Moderation
OpenAI content policy.
🔐
Secret Detection
Prevent credential leaks.
🕵️
PII Masking
Mask sensitive data.
View all guardrail providers →
Policies
Define and enforce usage policies across your LLM deployment.
📋
Guardrail Policies
Policy-based guardrail rules.
🔀
Policy Flow Builder
Visual policy configuration.
📄
Policy Templates
Pre-built policy templates.
AI Tools
Connect LiteLLM to AI-powered coding and productivity tools.
💬
OpenWebUI
Self-hosted ChatGPT-style interface.
🤖
Claude Code
Use LiteLLM with Claude Code.
🖱️
Cursor
AI code editor integration.
🐙
GitHub Copilot
GitHub Copilot integration.
💻
OpenCode
Open source coding assistant.
🔧
Retool Assist
Retool AI assistant.
Agent SDKs
Use LiteLLM with agent frameworks and SDKs.
🤖
OpenAI Agents SDK
Build agents with OpenAI's SDK.
🧠
Claude Agent SDK
Build agents with Anthropic's SDK.
🌐
Google ADK
Google Agent Development Kit.
🚀
CopilotKit
In-app AI copilots.
🧬
Letta
Build stateful LLM agents with persistent memory.
🎙️
LiveKit
Real-time voice and video AI agents.
Prompt Management
Manage, version, and deploy prompts.
📝
LiteLLM Prompt Management
Built-in prompt management.
🔌
Custom Prompt Management
Bring your own prompt store.
🔥
Arize Phoenix Prompts
Prompt management with Phoenix.
Manage with AI Agents
Use AI agents to manage your LiteLLM deployment — create users, teams, keys, models, and more via natural language.