AI and LLMs · Senior · Question 8 of 75
What is benchmark contamination?
- 1Test questions leaked into the model's training data
- 2Running a benchmark on a computer that has a virus
- 3Mixing results from two different benchmarks together
Show the answer
Correct answer: Test questions leaked into the model's training data
Explanation
A contaminated model may memorize answers, so public benchmark scores overstate ability. Private, fresh evals are more trustworthy.