Decision model benchmarks
These benchmarks test every decision model that LiteLLM supports on three jobs: as a guardrail, as an Auto Router classifier, and as an LLM judge for Lens Signals. Each model got the same requests through a LiteLLM proxy on /v1/decisions in October 2026. The self-hosted models ran on an 8-core CPU without a GPU, so their latency does not compare with the hosted models
The best model depends on the job. GPT-6 Luna is in the top group as a guardrail and as a Lens judge, but it sends 15 of 80 prompts to a cheaper tier in the Auto Router test. Decision-1 ties for second on routing but picks the right evidence for only 44% of Lens flags