AI and LLMs · Middle · Question 37 of 75
What is the "lost in the middle" effect?
- 1Models can miss information placed in the middle of long contexts
- 2The middle tokens of an answer are generated more slowly
- 3Messages in the middle of a chat are deleted by the API
Show the answer
Correct answer: Models can miss information placed in the middle of long contexts
Explanation
Put key instructions and the most relevant documents near the start or end, and keep contexts focused.