AI and LLMs · Senior · Question 14 of 75
When can a very long context replace RAG?
- 1Never; long context windows don't work in practice
- 2Always, since long context makes retrieval unnecessary
- 3For small, stable corpora where cost and latency are acceptable
Show the answer
Correct answer: For small, stable corpora where cost and latency are acceptable
Explanation
Stuffing a few documents is simpler. Large or changing corpora, access control and cost still favour retrieval.