Fairness in multi-tenant systems

There's a tension between building single-tenant systems and multi-tenant systems. Single-tenant are inherently isolated and customizable, where multi-tenant can be substantially more efficient. Choosing between the two is a Kobayashi Maru, of sorts, but you can win by changing the rules. In this article I talk about how we make multi-tenant systems like DynamoDB seem single-tenant by building fairness. The article also talks about how to go beyond hard-allocation of static throttling rules into a model that has the best of both worlds.