Scaling: out, not just up

Grow from one box to thousands: stateless servers, L4 vs L7 load balancing, and knowing exactly when to shard versus replicate.