AI and LLMs · Middle · Question 73 of 75
Why doesn't adding more retrieved chunks always improve RAG answers?
- 1Irrelevant chunks add noise and can push the model off track
- 2More chunks always make the final answer much shorter
- 3Models can read at most three chunks in a single request
Show the answer
Correct answer: Irrelevant chunks add noise and can push the model off track
Explanation
Precision matters as much as recall. A reranker and a sensible top-k keep the context focused and cheaper.