Cache stampede (thundering herd): what is it and how do you mitigate it?

Deep dive

Expanding on the short answer — what usually matters in practice:

• Context (tags): architecture, caching, cache-stampede, performance
• Scaling: what scales horizontally vs vertically, where bottlenecks appear.
• Reliability: retries/circuit breakers/idempotency, observability (logs/metrics/traces).
• Evolution: keep changes cheap (boundaries, contracts, tests).
• Explain the "why", not just the "what" (intuition + consequences).
• Trade-offs: what you gain/lose (time, memory, complexity, risk).
• Edge cases: empty inputs, large inputs, invalid inputs, concurrency.

Examples

A tiny example (an explanation template):

// Example: discuss trade-offs for "cache-stampede-(thundering-herd):-what-is-it-and"
function explain() {
  // Start from the core idea:
  // A cache stampede happens when many requests miss the cache at the same time (often when an
}

Common pitfalls

• Too generic: no concrete trade-offs or examples.
• Mixing average-case and worst-case (e.g., complexity).
• Ignoring constraints: memory, concurrency, network/disk costs.

Interview follow-ups

• When would you choose an alternative and why?
• What production issues show up and how do you diagnose them?
• How would you test edge cases?