Skip to main content

Technical Decisions

Load Balancer

A load balancer spreads requests across several servers. It buys resilience more often than speed, and it introduces requirements most people do not anticipate.

Definition

A load balancer sits in front of several servers and distributes incoming requests between them, so no single machine handles everything.

What It Actually Means

It also checks which servers are healthy and stops sending traffic to any that are not, which is the part that matters more than the distribution.

What It Actually Buys

Resilience, mostly. With one server, that machine failing means the system is down. With two behind a balancer, one failing means the other carries the traffic and most visitors notice nothing. For a business where downtime has a real cost, this is the main argument and it is a good one.

Maintenance without downtime. Update one server while the other serves traffic, then swap. This is how routine work stops requiring a maintenance window.

Capacity beyond one machine, which is the reason usually given and, for most businesses, the least relevant one. Very few systems genuinely exceed what a single well-configured server handles.

So the honest framing is that a load balancer is usually bought for uptime rather than for speed, and it is worth being clear about which you are paying for.

What It Requires

This is the part underestimated, because adding a second server changes assumptions the application may be making.

Sessions have to be shared. If login state is held on one server, a visitor bounced to the other appears logged out. Sessions need to live somewhere both can reach.

Uploaded files have to be shared. A file uploaded to one server does not exist on the other. Storage has to be shared or external.

Scheduled jobs must not run twice. A nightly task on both servers runs twice, which for anything sending email or charging cards is a real problem.

Deployment gets more involved. Both machines need updating, in a controlled order.

None of that is difficult. All of it has to be done deliberately, and an application built assuming one server will misbehave in ways that are hard to diagnose because they only affect some requests.

What To Ask

  • What are we buying, uptime or capacity? The answer should be honest, and it is usually uptime.
  • What does an hour of downtime cost us? This sets whether the arrangement is worth it. For many businesses it is not.
  • Is the application ready for more than one server? Sessions, uploads and scheduled jobs specifically.
  • What happens if the load balancer itself fails? It becomes the single point of failure it was meant to remove, unless the provider handles that.
  • Is there a simpler option? Reliable hosting with tested backups and a fast restore covers a great deal, at considerably lower cost and complexity.

The Proportionate Position

For most small and mid-sized business systems, a single well-maintained server with monitoring, tested backups and a rehearsed recovery route delivers availability in the range the business actually needs.

A load balancer earns its place when downtime is genuinely expensive per hour, or when maintenance windows have become unacceptable. Buying one to solve a scaling problem that does not exist adds cost and a set of new requirements, and it is a common way to make a simple system complicated without making it better.

More terms are in the glossary.

Portrait of Alexander De Sousa, founder of Digital Royalty
Founder-led
“I’ve put everything I know into how this company works — the standards, the method, the care on every project. It runs through the whole team, and I hold us all to it.”

Alexander De Sousa · Founder LinkedIn

Featured on BBC Radio Solent

Get started

Tell us what you need

A few quick questions, then a straight answer from a real person — usually within a few hours.

Tell us what you're working on

Whether it's a new site, a platform, or a process that shouldn't be manual any more — we'll tell you honestly if we can help.