Knowledgebase

Surviving Sudden Load Print

  • backenddevelopment, backend, caching, performance, errors, guide, howto, solution
  • 0

Sudden load.

WHAT CAUSES THEM

Marketing activity Being featured somewhere Seasonal events Automated traffic A defective client retrying

WHAT HAPPENS WITHOUT PREPARATION

Response times rise, timeouts cascade, and the service becomes unavailable.

WHAT PROTECTS

Rate limiting Caching aggressively Queueing work rather than performing it immediately Shedding load deliberately

WHAT SHEDDING LOAD MEANS

Rejecting some requests quickly, so the rest succeed.

WHY THAT IS BETTER

Serving most users is better than serving none slowly.

WHAT TO PREPARE IN ADVANCE

Knowing where your limit is Knowing what to disable under pressure Being able to scale, if the architecture allows

WHAT TO DISABLE UNDER PRESSURE

Expensive non-essential features: recommendations, analytics, search suggestions.

WHAT TO CACHE MOST AGGRESSIVELY

Whatever is requested most and changes least.

WHAT TO TEST

Behaviour at several times expected load.

WHAT TO WATCH DURING A SPIKE

Error rate and response times, not only request volume.

WHAT TO AVOID

Discovering your capacity during an event.


Was this answer helpful?
Back

Are you happy with your experience? Leave us a review on Trustpilot.


Trustpilot