AI and LLMs · Junior · Question 40 of 75
What does top-p (nucleus sampling) do?
- 1Picks the top p percent of users to receive faster answers
- 2Limits choices to the most likely tokens whose probabilities add up to p
- 3Limits the answer length to p paragraphs
Show the answer
Correct answer: Limits choices to the most likely tokens whose probabilities add up to p
Explanation
Like temperature, it controls randomness. Usually you adjust one of them, not both.