System Design · Senior · Question 70 of 75

A service handles 1,000 requests/s with an average latency of 200 ms. How many requests are in flight on average?

Explanation

This sizes thread pools and connection limits. If latency doubles at the same load, concurrency doubles too.

Further reading

Problem with a question

System Design · Senior · question 70

Test yourself

Take the System Design · Senior quiz: questions and options are shuffled, and you get a review of your mistakes at the end.

Take this quiz