📄️ Quickstart
Start LiteLLM with one command or one click and go from zero to your first gateway request in about five minutes, using the Admin UI for everything after startup.
📄️ CLI Quickstart
Setup LiteLLM Proxy quickly via CLI.
📄️ Benchmarks
Performance test results for LiteLLM Gateway.
🗃️ Deploy
8 items
🗃️ Configuration
4 items
🗃️ Models & Providers
8 items
🗃️ Client Setup
12 items
🗃️ Authentication & Access
15 items
🗃️ Spend Tracking
15 items
🗃️ Budgets & Rate Limits
13 items
📄️ Enterprise
LiteLLM Enterprise is the open-source AI Gateway plus SSO, audit logs, delegated admin roles, multi-region deployment, and support SLAs, self-hosted in your cloud.
📄️ Load Balancing, Routing, Fallbacks (Failover)
📄️ A/B Testing - Traffic Mirroring
Traffic mirroring allows you to "mimic" production traffic to a secondary (silent) model for evaluation purposes. The silent model's response is gathered in the background and does not affect the latency or result of the primary request.
🗃️ Caching
8 items
🗃️ Guardrails
9 items
🗃️ Policies
4 items
🗃️ Logging, Alerting, Metrics
5 items
🗃️ Cost Optimization
6 items
📄️ Memory Management
Store user preferences and feedback so your LLM remembers them across sessions. Scoped per user and team, with built-in access control.
🗃️ Admin UI
7 items
🗃️ LiteAdmin
3 items
📄️ LiteLLM Proxy CLI
The lite CLI is a command-line tool for managing your LiteLLM proxy
🗃️ Create Custom Plugins
Modify requests, responses, and more
🗃️ Architecture
5 items
🔗 All Endpoints (Swagger)
🗃️ Troubleshooting
3 items