AI and LLMs · Senior · Question 9 of 75
How can an LLM judge drift over time?
- 1The judge gets tired after scoring many answers
- 2The judge's scores always drift up by one point a month
- 3The judge model is updated and starts scoring differently
Show the answer
Correct answer: The judge model is updated and starts scoring differently
Explanation
Pin judge versions and re-check agreement with human labels when changing the judge, or score shifts look like quality changes.