AI and LLMs · Senior · Question 40 of 75
Why is abstention ("I don't know") an important behaviour to evaluate?
- 1Abstentions make every interaction shorter for users
- 2Models must abstain on a fixed share of all requests
- 3Answering confidently without evidence is worse than declining
Show the answer
Correct answer: Answering confidently without evidence is worse than declining
Explanation
Evals should include unanswerable questions and reward correct refusals, not just answer accuracy.