AI and LLMs · Senior · Question 39 of 75
How can a team measure the hallucination rate of a RAG assistant?
- 1Ask users whether they think the assistant hallucinates
- 2Sample answers and check claims against sources, by judge and humans
- 3Count the answers that contain the word "maybe"
Show the answer
Correct answer: Sample answers and check claims against sources, by judge and humans
Explanation
Faithfulness scoring on a regular sample, calibrated with human checks, gives a trend you can act on.