AI and LLMs · Senior · Question 3 of 75
How should success criteria for an AI feature be defined?
- 1As "the model should be good" so the team stays flexible
- 2Only by the model provider's published benchmark scores
- 3Specific, measurable and tied to the task, e.g. 95% accuracy
Show the answer
Correct answer: Specific, measurable and tied to the task, e.g. 95% accuracy
Explanation
Vague goals can't be tested. Concrete targets for accuracy, latency, cost and safety guide trade-offs.