AI and LLMs · Junior · Question 41 of 75
What is the role of the transformer's attention mechanism?
- 1Letting each token weigh how relevant other tokens are
- 2Deciding which user's request to process first
- 3Detecting when the user stops paying attention
Show the answer
Correct answer: Letting each token weigh how relevant other tokens are
Explanation
Attention is what lets models use context across long text, and it's a key reason for the transformer architecture's success.