AI and LLMs · Junior · Question 19 of 75

Why are documents split into chunks for RAG?

Show the answer

Correct answer: To retrieve only the relevant parts and fit them in the context

Explanation

Chunk size is a trade-off: too small loses context, too large brings in noise and uses tokens.

Further reading

Problem with a question

AI and LLMs · Junior · question 19

Test yourself

Take the AI and LLMs · Junior quiz: questions and options are shuffled, and you get a review of your mistakes at the end.

Take this quiz