AI and LLMs · Senior · Question 37 of 75
Why roll out prompt changes gradually behind flags?
- 1Real traffic shows what evals missed; rollback is fast
- 2Flags make prompts shorter and therefore cheaper
- 3Providers require flags for every prompt change
Show the answer
Correct answer: Real traffic shows what evals missed; rollback is fast
Explanation
Canary a new prompt to 5% of users, watch quality and cost metrics, then expand.