AI and LLMs · Junior · Question 28 of 75

What should an app do when the LLM API returns `429`?

1Show the raw error to the user and stop
2Retry instantly in a tight loop
3Retry with backoff and respect rate limits

Show the answer

Correct answer: Retry with backoff and respect rate limits

Explanation

Providers limit requests and tokens per minute. Backoff, queues and clear user messages handle bursts gracefully.

Further reading

Test yourself

Take the AI and LLMs · Junior quiz: questions and options are shuffled, and you get a review of your mistakes at the end.