Skip to main content

2 posts tagged with "jev"

View All Tags

Day 0 Support: TypeSafe Jev 1.14: Adds images, box questions, and long context

Kerry Lu
Rust Engineer, LiteLLM
Mateo Wang
AI Engineer, LiteLLM

TypeSafe's Jev 1.14 adds a question type, box, that answers with where something is in an image. LiteLLM supports it from day 0 on both decision routes, POST /v1/systemone and POST /v1/decisions, together with TypeSafe's image input and long-context mode. If you are new to Jev, start with the TypeSafe Jev launch post and the decision models post, which cover what a decision model is and how the two routes relate. Request jev-1.14.0 through the proxy and the same virtual keys, budgets, spend logs and fallbacks you already use for decision models apply.

TypeSafe Jev on LiteLLM

Kerry Lu
Rust Engineer, LiteLLM

TypeSafe AI's Jev launches on LiteLLM today in v1.103.0-rc. Jev is a decision model: it returns a choice, a score, or a yes/no probability instead of text, so it has its own evaluate endpoint rather than /chat/completions. LiteLLM proxies that endpoint with logging and cost tracking.