LiteLLM v1.56.1
Adds budget and rate limit tiers for keys, fine-tuning endpoint logs and dynamic guardrail parameters. Also fixes a double-logged OTEL span.
Adds budget and rate limit tiers for keys, fine-tuning endpoint logs and dynamic guardrail parameters. Also fixes a double-logged OTEL span.
Adds guardrail trace logging, a /guardrails/list endpoint and mock_response support for guardrails. Also assigns keys to users in the Proxy UI.
Adds the opt-in store_prompts_in_spend_logs option, which shows messages and responses in the Admin UI. It is off by default.
Adds OpenAI image variations with Topaz support, DeepSeek R1 reasoning_content and more Bedrock Nova document types. Also adds Azure o1 pricing.