Skip to main content

Enterprise

For companies that need SSO, user management and professional support for LiteLLM Proxy

info

Get free 7-day trial key here

Enterprise Features​

Includes all enterprise features.

Procurement available via AWS / Azure Marketplace

This covers:

  • Enterprise Features
  • ✅ Feature Prioritization
  • ✅ Custom Integrations
  • ✅ Professional Support - Dedicated Slack/Teams channel

Self-Hosted​

Manage Yourself - you can deploy our Docker Image or build a custom image from our pip package, and manage your own infrastructure. In this case, we would give you a license key + provide support via a dedicated support channel.

What’s the cost of the Self-Managed Enterprise edition?​

Self-Managed Enterprise deployments require our team to understand your exact needs. Get in touch with us to learn more

How does deployment with Enterprise License work?​

You just deploy our docker image and get an enterprise license key to add to your environment to unlock additional functionality (SSO, Prometheus metrics, etc.). 

LITELLM_LICENSE="eyJ..."

No data leaves your environment.

Hosted LiteLLM Proxy​

LiteLLM maintains the proxy, so you can focus on your core products.

We provide a dedicated proxy for your team, and manage the infrastructure.

Status: GA​

Our proxy is already used in production by customers.

See our status page for live reliability

Benefits​

  • No Maintenance, No Infra: We'll maintain the proxy, and spin up any additional infrastructure (e.g.: separate server for spend logs) to make sure you can load balance + track spend across multiple LLM projects.
  • Reliable: Our hosted proxy is tested on 1k requests per second, making it reliable for high load.
  • Secure: LiteLLM is SOC-2 Type 2 and ISO 27001 certified, to make sure your data is as secure as possible.

Supported data regions for LiteLLM Cloud​

You can find supported data regions litellm here

Frequently Asked Questions​

SLA's + Professional Support​

Professional Support can assist with LLM/Provider integrations, deployment, upgrade management, and LLM Provider troubleshooting. We can’t solve your own infrastructure-related issues but we will guide you to fix them.

  • 1 hour for Sev0 issues - 100% production traffic is failing
  • 6 hours for Sev1 - <100% production traffic is failing
  • 24h for Sev2-Sev3 between 7am – 7pm PT (Monday through Saturday) - setup issues e.g. Redis working on our end, but not on your infrastructure.
  • 72h SLA for patching vulnerabilities in the software.

We can offer custom SLAs based on your needs and the severity of the issue

Data Security / Legal / Compliance FAQs​

Data Security / Legal / Compliance FAQs

Pricing​

Pricing is based on usage. We can figure out a price that works for your team, on the call.

Contact Us to learn more

Screenshots​

1. Create keys​

2. Add Models​

3. Track spend​

4. Configure load balancing​