Model Router
Automatically use the best LLM for each task.
What is it?
The Optimix model router automatically routes your incoming requests to the best LLM for your specific task and end-user. It uses a multi-armed bandit reinforcement learning algorithm to select the best model based on latency data, estimated costs, and historical quality of output.
Essentially, it learns from your historical requests to select the best model. So the more you use Optimix, the better the router gets.
How do I use it?
You can start using the Optimix model router in the Playground and in your API requests by selecting optimix-router in the model selection dropdowns.
Playground
You can easily test the router in the Playground, and view which models are selected and how they perform.
Optimix Router in Playground
Prompt Page
By selecting optimix-router as the model for your prompt, all future API and Playground requests to this Prompt will have the router enabled.
Optimix Router in Prompts