Release Notes
LiteLLM ships new releases regularly with new provider support, performance improvements, and enterprise features. Use the sidebar to browse all releases.
Latest Release​
v1.98.0: Provisioned Throughput Billing, Shadow Evals & Routing Groups​
August 22, 2026
Provisioned throughput is billed as reserved capacity, with ptu_count and cost_per_ptu_per_hour on a deployment driving a per-model flat cost by active hour while per-token billing is switched off there, so a team paying for reserved capacity is not charged twice for the same traffic; a shadow eval job that samples a slice of one key's successful traffic, replays it through the auto-router in a detached task that never serves a response or adds latency, and has an LLM judge compare both answers blind, so the router can be measured before it is adopted; routing groups that are callable models, where model=<group_name> routes across the union of member deployments with the group's own strategy, appears in /v1/models for Claude Code and Codex discovery, and is grantable on keys and teams; six x-litellm-response-cost-* headers that split a response's cost into input, cache read, cache creation, output, reasoning, and tool usage; TPM reservations that follow declared output size per key, per team, and per model instead of one static floor for every tenant; and the largest step yet in the Admin UI's move off antd and Tremor, with 75 UI pull requests carrying the navbar, playground, usage, cost tracking, the log details drawer, and much of the shared component library onto shadcn. Note that the Langfuse metadata blob is now sourced from a StandardLoggingPayload allowlist, so roughly 20 fields no longer appear on the generation.
Recent Releases​
| Version | Date | Highlights |
|---|---|---|
| v1.98.0 | Aug 22, 2026 | Provisioned throughput billing, auto-router shadow evals, callable routing groups |
| v1.97.0 | Aug 15, 2026 | Tool-result guardrails, auto-router deployment affinity, admin viewer parity |
| v1.96.0 | Aug 9, 2026 | MCP entitlements, Redis config sync, auto-router context, GPT-5.6 price cut |
| v1.95.0 | Aug 1, 2026 | Claude Opus 5, MCP gateway DCR, Rust /v1/messages, SAML 2.0 SSO |
| v1.94.0 | Jul 28, 2026 | Router plugins & Auto-Router v2, MCP client-held credentials, shared DataTable UI |
| v1.93.0 | Jul 18, 2026 | GPT-5.6, client-forwarded MCP credentials, Meta Model API provider |
| v1.92.0 | Jul 11, 2026 | Claude Sonnet 5, production MCP OAuth (On-Behalf-Of) v2, Tencent & GDC providers |
| v1.91.0 | Jul 4, 2026 | MCP OAuth 2.0 v2 resolver, Rust OCR gateway, realtime performance |
| v1.90.0 | Jun 26, 2026 | Six new providers, OpenTelemetry v2 metrics parity, streaming-reliability sweep |
| v1.89.0 | Jun 10, 2026 | Claude Fable 5, A2A agent providers, MCP per-server controls |
| v1.88.0 | Jun 4, 2026 | Claude Opus 4.8, MCP access-group authorization, typed OpenTelemetry |
| v1.87.0 | May 23, 2026 | OCI Generative AI provider, Gemini 3.5 Flash day-0, MCP UI for OAuth servers |
| v1.86.0 | May 16, 2026 | Weighted-Routing Failover, native Anthropic web-search citations, OTel-standard server spans |
| v1.85.1 | May 20, 2026 | Patch — Gemini 3.5 Flash day-0 + cross-pod spend fix |
| v1.84.1 | May 20, 2026 | Patch — Gemini 3.5 Flash day-0 + cross-pod spend fix |
| v1.85.0 | May 16, 2026 | Realtime GA, MCP Gateway expansion & hardened multi-tenancy |
| v1.84.0 | May 14, 2026 | Reliability hardening + multi-pod budget accuracy |
| v1.83.14 | Apr 27, 2026 | GPT-5.5, Prompt Compression & Memory API |
| v1.83.10 | Apr 27, 2026 | Claude Opus 4.7, Prompt Compression & Multi-Window Budgets |
| v1.82.3 | Mar 16, 2026 | Nebius AI, gpt-5.4, Gemini 3.x, FLUX Kontext, and 116 new models |
| v1.82.0 | Feb 28, 2026 | Realtime Guardrails, Projects Management, and 10+ Performance Optimizations |
| v1.81.14 | Feb 21, 2026 | New Gateway Level Guardrails & Compliance Playground |
| v1.81.12 | Feb 14, 2026 | Guardrail Policy Templates & Action Builder |
| v1.81.9 | Feb 7, 2026 | Control which MCP Servers are exposed on the Internet |
| v1.81.6 | Jan 31, 2026 | Logs v2 with Tool Call Tracing |
| v1.81.3 | Jan 26, 2026 | Performance — 25% CPU Usage Reduction |
| v1.81.0 | Jan 18, 2026 | Claude Code — Web Search Across All Providers |
| v1.80.15 | Jan 10, 2026 | Manus API Support |
| v1.80.8 | Dec 6, 2025 | Introducing A2A Agent Gateway |
| v1.80.5 | Nov 22, 2025 | Gemini 3.0 Support |
| v1.80.0 | Nov 15, 2025 | Introducing Agent Hub: Register, Publish, and Share Agents |
| v1.79.3 | Nov 8, 2025 | Built-in Guardrails on AI Gateway |
| v1.79.0 | Oct 26, 2025 | Search APIs |
| v1.78.5 | Oct 18, 2025 | Native OCR Support |
| v1.78.0 | Oct 11, 2025 | MCP Gateway: Control Tool Access by Team, Key |
| v1.77.7 | Oct 4, 2025 | 2.9x Lower Median Latency |
| v1.77.5 | Sep 29, 2025 | MCP OAuth 2.0 Support |
| v1.77.3 | Sep 21, 2025 | Priority Based Rate Limiting |
Stay Updated​
- GitHub: Watch the BerriAI/litellm repository for release notifications
- Discord: Join our community for announcements
- Twitter: Follow @LiteLLM
Use the sidebar to browse the full release history.