AI and LLMs · Middle · Question 42 of 75
How do you A/B test two prompts in production safely?
- 1Switch all users to the new prompt and compare yesterday's data
- 2Ask a few colleagues which prompt they like more
- 3Split traffic, measure agreed metrics and run offline evals first
Show the answer
Correct answer: Split traffic, measure agreed metrics and run offline evals first
Explanation
Offline evals catch obvious regressions; online metrics like resolution rate and feedback show real impact.