Load Testing · Middle · Question 41 of 76
The new build's p95 is 8% higher than the baseline. What do you check first?
- 1Whether the gap is bigger than the usual run-to-run variance
- 2Whether the load tool version changed since last year
- 3Nothing: any increase means the build must be rejected
Show the answer
Correct answer: Whether the gap is bigger than the usual run-to-run variance
Explanation
Compare against the spread of several baseline runs. Inside the noise means nothing. A stable, repeated increase is a regression to investigate.