AI and LLMs · Middle · Question 34 of 75
What is model routing for cost control?
- 1Picking a random model for each request to spread the load
- 2Sending easy requests to a cheaper model and hard ones to a stronger one
- 3Routing all requests through a VPN to get lower prices
Show the answer
Correct answer: Sending easy requests to a cheaper model and hard ones to a stronger one
Explanation
A classifier or rules decide. Evals confirm the cheap path is good enough for the cases sent to it.