Load Testing · Senior · Question 10 of 76
How do you make performance thresholds in CI stable enough to block merges?
- 1Dedicated runners, several runs, and limits based on measured noise
- 2Use the average of a single run, because it's the most stable
- 3Run on shared CI agents and fail on any 1% increase in p95
Show the answer
Correct answer: Dedicated runners, several runs, and limits based on measured noise
Explanation
Shared runners are noisy. Pin the environment, repeat runs, and set tolerance from the baseline's variance, or tests will fail randomly and be ignored.