📄️ Getting Started Tutorial
End-to-End tutorial for LiteLLM Proxy to:
🔗 A2A Agent Gateway
🔗 MCP Gateway
🗃️ Config.yaml
3 items
🗃️ Setup & Deployment
10 items
🔗 Demo LiteLLM Cloud
🗃️ Admin UI
11 items
🗃️ Architecture
10 items
🔗 All Endpoints (Swagger)
📄️ ✨ Enterprise Features
To get a license, get in touch with us here
🗃️ Authentication
9 items
🗃️ Budgets + Rate Limits
7 items
📄️ Caching
For OpenAI/Anthropic Prompt Caching, go here
🗃️ Create Custom Plugins
Modify requests, responses, and more
📄️ LiteLLM Proxy CLI
The litellm-proxy CLI is a command-line tool for managing your LiteLLM proxy
🔗 Load Balancing, Routing, Fallbacks
📄️ A/B Testing - Traffic Mirroring
Traffic mirroring allows you to "mimic" production traffic to a secondary (silent) model for evaluation purposes. The silent model's response is gathered in the background and does not affect the latency or result of the primary request.
🗃️ Logging, Alerting, Metrics
5 items
🗃️ Making LLM Requests
6 items
🗃️ Model Access
4 items
🗃️ Secret Managers
10 items
🗃️ Spend Tracking
8 items