Challenge
Keep reads fast through a cache restart
Profiles are read far more than written, and a few are very hot. The database has few workers, so reads queue.
At 7 s the cache restarts empty. Keep reads fast and successful through the cold start, within budget.
Goodput
≥ 99.0%
every seed
Success p99
< 80 ms
every seed
Budget
$400/mo
★★ at ≤ $320
Traffic
1,500 req/s (Poisson)
deadline 250 ms
Failure · cache
kill
at t = 7 s
- Client
- Load balancer
- Service
- Cache
- Database
- Rate limiter
- duplicateEffect