AI and LLMs · Senior · Question 72 of 75

Why is it risky to use the same model as both generator and only judge?

Show the answer

Correct answer: It may favour its own style and share the same blind spots

Explanation

Self-preference bias inflates scores. Use a different judge, rubrics and human calibration.

Further reading

Problem with a question

AI and LLMs · Senior · question 72

Test yourself

Take the AI and LLMs · Senior quiz: questions and options are shuffled, and you get a review of your mistakes at the end.

Take this quiz