API Design · Senior · Question 67 of 75
How do you keep one large tenant from degrading a shared API for everyone?
- 1Ignore it; load balancers handle fairness
- ✓Correct answer: Per-tenant rate limits and quotas, fair queuing, separate pools for heavy operations, and moving very large tenants to dedicated capacity
- 3Give the large tenant unlimited access
Explanation
This 'noisy neighbor' problem is mostly solved by isolation: limits, queues and capacity per tenant.