AI and LLMs · Senior · Question 51 of 75
What is a capacity risk specific to LLM features?
- 1LLM features use no server resources at all
- 2Provider rate limits can cap traffic during spikes
- 3Models get slower the more users have accounts
Show the answer
Correct answer: Provider rate limits can cap traffic during spikes
Explanation
Plan quotas with the provider, queue non-urgent work, and degrade gracefully when limits are near.