AI and LLMs · Senior · Question 48 of 75
How do you test a guardrail without making it too strict?
- 1Measure only how many harmful cases it blocks
- 2Measure missed harmful cases and blocked harmless ones
- 3Make it block everything and relax it later
Show the answer
Correct answer: Measure missed harmful cases and blocked harmless ones
Explanation
Precision and recall of the guardrail on labelled data show the trade-off; product decides acceptable levels.