New Datacenter for WordPress.com

16 Feb

Towards the end of 2008, we brought online a new datacenter to serve the over 5.5 million blogs now hosted on the WordPress.com platform.  Adding the data center in Chicago, IL gives us a total of 3 data centers across the US which serve live content at any given time.  We have decommissioned one of our facilities in the Dallas, TX area.  Our friends at Layered Technologies were kind enough to shoot this footage for us (think The Blair Witch Project) and the always awesome Michael Pick took care of the editing.  Here’s a peak at what a typical WordPress data center installation looks like…

For those interested in technical details here is a hardware overview of the installation:

150 HP DL165s dual quad-core AMD 2354 processors 2GB-4GB RAM
50 HP DL365s dual dual-core AMD 2218 processors 4GB-16GB RAM
5 HP DL185s dual quad-core AMD 2354 processors 4GB RAM

And here is a graph of what the current CPU usage looks like across about 700 CPU cores.  As you can see there is plenty of idle CPU for those big spikes or in case one of the other 2 data centers fail and we have to route more traffic to this one.

cpuusage-chicago

34 Responses to “New Datacenter for WordPress.com”

  1. Chris Jean February 16, 2009 at 12:23 pm #

    That’s very cool Barry.

    I’m in a similar position to you, but I can’t imagine managing and planning that amount of hardware.

    Good work.

  2. Angela February 16, 2009 at 11:10 pm #

    Great post Barry. Thanks for sharing the technical details; I am sure many people find this information useful.

  3. rjhintz February 17, 2009 at 10:30 am #

    Thanks for this perspective.

    How many k-watts/rack? Servers/rack? AC power only?

  4. James February 18, 2009 at 9:18 pm #

    nice…very nice

  5. The Frosty @WPCult February 19, 2009 at 2:13 am #

    Boy, a guy can dream!

  6. Kate Mag February 20, 2009 at 2:43 pm #

    Wow!

  7. GrG February 21, 2009 at 12:49 pm #

    Can i find more details, somewhere or are they secret?

    For example, are you using a Load Balanced cluster?

    I’m very interested in the WP infrastructure

    GrG

  8. Capripot March 19, 2009 at 2:45 pm #

    How do you do to keep wordpress.com free ?

  9. qwertz May 15, 2009 at 2:35 am #

    I see you’re using munin to gather your data. how do you sum up the values? in the munin config file or is there some automagic way? is a pain to add each new server to the sum paragraphs in the munin file – that’s how we do it atm.

    • Barry May 21, 2009 at 3:03 pm #

      We have a simple-ish script which reads the sever info from Servermattic and generates the munin configs automatically. This includes adding/removing hosts and producing the aggregate graph definitions.

      • qwertz May 22, 2009 at 2:11 pm #

        thanks Barry will have a look

  10. Erik November 17, 2009 at 11:13 am #

    Hi Barry,

    I really like the fact that you seem to heavily rely on open source software.

    Whenever I’m hoping to establish a new service, I try to base them on open source software. However I’ve found it hard to find any good realtime file replication services for Linux.

    Would you mind telling how you guys handle it? I assume you do file replication between the datacenters.

    regards,
    Erik

  11. Jay October 20, 2010 at 4:13 pm #

    Thats crazy!
    So much to keep track of..

    Glad Im not responsible

  12. fajarramd March 31, 2012 at 9:25 pm #

    Reblogged this on fajarramd.

Trackbacks/Pingbacks

  1. WordPress’ Newest Data Center - One Man’s Blog - February 17, 2009

    [...] this morning he posted a little article about the newest WordPress data center and included a video shot by Aaron Phillips. Watch really closely and you might catch a glimpse of [...]

  2. Le nouveau datacenter de Wordpress.com - February 17, 2009

    [...] http://barry.wordpress.com/2009/02/16/new-datacenter-for-wordpresscom/ [...]

  3. iWeb Blog » Nouvelles Techno iWeb: neutralité Internet, Vint Cerf et infrastructure des réseaux sociaux - February 18, 2009

    [...] sont bons derniers. Si vous êtes intéressés par l’infrastructure de réseaux sociaux, WordPress a publié aussi des détails (et une vidéo) sur leur nouveau centre de données.  SubscribeDiggdel.icio.usFacebookRedditStumbleUpon  |  (Pas de [...]

  4. iWeb Blog » iWeb Tech News Highlights: net neutrality, Vint Cerf and infrastructure of social networks - February 18, 2009

    [...] LinkedIn trail, in a pingdom study. If you are interested in the infrastructure of social networks, WordPress has a post (and a video) about their new data center. SubscribeDiggdel.icio.usFacebookRedditStumbleUpon  |  (No Ratings [...]

  5. New Datacenter for WordPress.com « b0pen - February 18, 2009

    [...] New Datacenter for WordPress.com « Barry on WordPress. [...]

  6. The hardware behind WordPress.com | WPLover - February 18, 2009

    [...] The hardware behind WordPress.com [...]

  7. Nou centre de dades de WordPress - February 19, 2009

    [...] gent de WordPress acaba d’anunciar l’adquisició de un nou centre de dades a la ciutat de Chicago, per donar suport als prop de 5.5 milions de blogs allotjats a sota la seva [...]

  8. Web roundup « MySQLTalk.com - February 19, 2009

    [...] Congratulations to WordPress on their new datacenter. [...]

  9. VNunet reviens sur l’architecture technique de Wordpress.com | BuddyGrid - February 20, 2009

    [...] article fait écho au post du blog de Barry Abrahamson donnant les détails de l’architecture. Espérons que BuddyGrid en arrive là un jour. [...]

  10. WordPress.com peut supporter 5 millions de blogs ?! - Hchicha 100% DZ :) - February 20, 2009

    [...] hchicha on fév.20, 2009, under WordPress L’équipe de WordPress a annoncé récemment que WordPress.com peut désormais supporter l’hébergement de plus de 5.5 millions de blogs. [...]

  11. actu-libre - February 20, 2009

    Des nouveaux serveurs chez wordpress.com…

    je viens de découvrir que le blog de Barry Abrahamson que wordpress vient de mettre en service une nouvelle infrastructure pour pouvoir gérer plus de 5.5 millions de blog sur le domaine wordpress.com .
    Bon certains me diront vive la centralisation de…

  12. WordPress.com - February 20, 2009

    [...] HP servers . Racks, server, dual Quad Core CPU, air condition, go. post barry. [...]

  13. Tech News Highlights: Feb 17 - 23, 2009 « D.I.Y. Web Hosting Blog - February 24, 2009

    [...] – Pingdom release downtime statistics for the top social networks in 2008. – The hardware behind WordPress.com’s new Chicago data center. – Most mobile phone manufacturers agree on a universal phone charger. – First technical details [...]

  14. 5 Servers Run WordPress.com…200 Run Akismet | The Minority Report - February 24, 2009

    [...] New Datacenter for WordPress.com « Barry on WordPress [...]

  15. my digital home « [Todo es digital] - March 16, 2009

    [...] New datacenter for wordpress en un blog vecino. [...]

  16. New Datacenter for WordPress.com | Articles-warehouse.com Blogs - June 17, 2009

    [...] Towards the end of 2008, we brought online a new datacenter to serve the over 5.5 million blogs now hosted on the WordPress.com platform.  Adding the data center in Chicago, IL gives us a total of 3 data centers across the US which serve live content at any given time.  We have decommissioned one of [...] [...]

  17. WUWT adminstrative note | Watts Up With That? - August 24, 2010

    [...] More information, including a (somewhat shaky) video of the wordpress.com server facility is available here. [...]

  18. Il Cloud « innovaretelit - April 5, 2012

    [...] http://barry.wordpress.com/2009/02/16/new-datacenter-for-wordpresscom/ [...]

  19. Wordpress Overview - October 9, 2012

    [...] “New Datacenter for WordPress.com.” Barry On WordPress.http://barry.wordpress.com/2009/02/16/new-datacenter-for-wordpresscom/. (May 24, [...]

  20. Data Center Tours: Wordpress Rechenzentrum › NETWAYS Blog - November 15, 2012

    [...] diesem Blogpost gibt es ein paar Informationen über die technische Infrastruktur von wordpress.com. Die [...]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 858 other followers

%d bloggers like this: