Load balancer testing

30 Aug

Over the past week here at wordpress.com, we have been doing some experimentation with various software load balancers. In the latest test, we are using Pound with a weighted round-robin algorithm between all of the web servers in a given datacenter. The individual weight takes into account hardware differences and any other tasks that server may be doing. So, a dual processor server would receive more traffic than a single processor machine. The tests have been going really well so far.  Once the testing is complete and we have decided on a solution, I will post about the various things we tried, pros and cons of each, etc.  The graph below shows the load averages of the various web servers over a one week period. I’ll let you guess when the test began :) Pretty dramatic difference, eh?

totals-web_load-week.png

11 Responses to “Load balancer testing”

  1. adam August 30, 2006 at 7:06 pm #

    impressive, both for the drop, and for the rapidly increasing loads leading up to it.

  2. Blade August 30, 2006 at 10:23 pm #

    It’s to bad other sites on the net will not do this from time to time.
    I like it when a site Admin takes great links to make shear that his or her site is running in top shape.
    I glade I’m on WordPress.

  3. blaze August 31, 2006 at 12:57 pm #

    I really couldn’t work that stuff out if i tried. This is why I am glad I leave it to the experts :)

  4. Vinny September 4, 2006 at 1:44 am #

    Any reason you’re not considering using hardware load balancers like F5 BIG-IP’s, besides the cost I guess? BIG-IP offer awesome load balancing and failover support in addition to data-center and geographic redundancy when paired with their 3DNS product.

    PS: I’m just a happy customer :)

  5. barry September 7, 2006 at 7:20 am #

    F5s are great – I have used many of them in the past. The approach here is a little different though and I prefer to use commodity hardware both for the flexibility and the cost savings. Purchasing 2 F5s in a failover pair for a single data center may be a “little” expensive, but purchasing 10 sets for 10 data centers becomes *very* expensive. As the site grows and we look at setting up more points of presence around the world this becomes a big issue. Also, if you use such expensive specialized hardware in your configuration, you tend to become tied to having a few, large points of presence rather than many, smaller ones.

  6. robbwindow October 14, 2006 at 10:49 am #

    I still don’t feel any the wiser, but I shall perservere searching you guy’s are great I have faith in your progression, cause I just don’t have time these days.

  7. Alex November 14, 2006 at 3:15 pm #

    Wondering if you’d finished your testing and had an update yet on what software load balancers were good or not so good please?

    I’m looking at using one on Amazon’s EC2 service.

    Thanks,
    Alex

  8. barry November 16, 2006 at 8:49 am #

    We are currently using pound. It had all the functionality we needed and performance is ok (not great). We needed something that handled SSL, so our options were somewhat limited by that. If you don’t need SSL, you may want to look at perlbal.

  9. Danny Howard December 21, 2006 at 1:28 am #

    You guys are still deciding? I have a similar agenda . . . glad to see you’re digging Pound . . .

    -danny

Trackbacks/Pingbacks

  1. WordPress.com Load balancer testing « - August 30, 2006

    [...] Barry (our sysadmin) has posted on the load balancer testing we’ve been doing to even out some bumps around here. [...]

  2. Load Balancer Update « Barry on WordPress - April 28, 2008

    [...] « Amazon AWS Outage Load Balancer Update April 28, 2008 A while back, I posted about some testing we were doing of various software load balancers for WordPress.com.  We chose [...]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 846 other followers

%d bloggers like this: