AI and LLMs · Middle · Question 72 of 75
Why should an AI feature have a cost budget per user or tenant?
- 1So a few heavy users or abuse can't run up huge bills
- 2Budgets make the model answer more accurately
- 3Providers require budgets for each end user
Show the answer
Correct answer: So a few heavy users or abuse can't run up huge bills
Explanation
Track spend per user, alert on spikes and degrade gracefully, for example to a smaller model, when limits are reached.