AI and LLMs · Junior · Question 58 of 75

What is a simple automated check for a chatbot answer?

1Assert it is identical to yesterday's saved answer
2Assert it has the required fact and nothing forbidden
3Assert the answer has exactly 100 words

Show the answer

Correct answer: Assert it has the required fact and nothing forbidden

Explanation

Simple code checks (contains, regex, length, JSON validity) are cheap and catch many regressions before using a judge model.

Further reading

Test yourself

Take the AI and LLMs · Junior quiz: questions and options are shuffled, and you get a review of your mistakes at the end.