AI and LLMs · Middle · Question 68 of 75
Why keep humans in evaluation even with automated judges?
- 1Humans are faster than automated judges
- 2Automated judges are illegal in most countries
- 3Humans catch subtle problems and keep judges calibrated
Show the answer
Correct answer: Humans catch subtle problems and keep judges calibrated
Explanation
Regular human review of samples finds new failure types that become rubric items and test cases.