Lessons in Optimizing a Really Huge Blog

Up until now, I haven’t had any close experience doing server-side optimization of a highly-trafficked blog. When I say “highly-trafficked”, I mean it’s like being on the front page of Digg all day, 7 days a week.

I have had some experiences with vBulletin forums getting concurrent connections in the vicinity of 500 but a WordPress blog clocking in 1,000 concurrent connections is something else. Btw, I’m talking about Rickey’s blog on Americal Idol.

Yugatech 728x90 Reno7 Series

Whos Online
The blog peaks at 1,161 concurrent users during peak hours.

Here are some stuff I’ve learned so far and I hope will be of good use to other bloggers who reaches this level of traffic:

  • If you can afford it, get two separate dedicated servers to host Apache and mySQL. So we’ve got a Pentium 4 2.8GHz Dual Core with 3GB of RAM to run Apache and all static files and another Pentium 2.8GHz with 4GB of RAM to run mySQL. This set up seems better than my own Dual Xeon server with 4GB of RAM.
  • Upgrade to PHP5 and mySQL5 if you haven’t done so. Both newer versions have general performance benefits over the older ones.
  • Optimize server configurations. Most new owners of dedicated servers will have to face the challenge of having a good mix of settings in their php.ini, httpd.conf and my.cnf. Here is where you set connection limits, time outs, and memory caching/allocation. Making the most of your available server memory will determine whether your server will conk out or not when the moment strikes and the barrage of traffic comes in.
  • PHP Opcode Caching. There are several free ones available such as eAccelerator, Alternative PHP Cache (APC), and the XCache. These are basically frameworks for caching and optimizing PHP intermediate code and really helps if you run a lot of WP plugins.
  • For WordPress blogs, running WP Super Cache is highly recommended. You can also use PHP Speedy to compress and speed up page deliveries.
  • Monitor. Tweak. Optimize. Wash, rinse and repeat. You won’t hit it the first time and it’s gonna be frustrating. Just watch out for the peak hours, log the volume of traffic, watch their behavior (commenters vs. viewers) and tweak again based on that volume.

As for the cost, it depends and will vary between a hundred dollars to a couple hundred. Server management is the most expensive IMO as they charge as much as $75 per hour just to take a look at your server.

And no, a 500GB + 5 terabyte $20/month shared hosting will not cut it. They’ll kick you out before your blog can even reach 1TB.

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 837 other subscribers
Avatar for Abe Olandres

Abe is the founder and Editor-in-Chief of YugaTech with over 20 years of experience in the technology industry. He is one of the pioneers of blogging in the country and considered by many as the Father of Tech Blogging in the Philippines. He is also a technology consultant, a tech columnist with several national publications, resource speaker and mentor/advisor to several start-up companies.

23 Responses

  1. Avatar for John Alvero John Alvero says:

    This post is old already, to keep it current and keep up with the latest, Clouding Computing technology such as the one offered by Amazon EC2 is worth looking at. It may not be the cheapest but some might go this way.

    This way, it is very easy to scale-up or scale-out your infrastructure. Just choose what type of server instance depending on your memory and cpu needs. You can also choose small instances and and add more small instances during high traffic — the best part is you can even script this process. Here you pay by the hour, so during low traffic you can terminate some of the services instances. Cool huh.

    Oh btw, did I mention that we already have an Amazon Asia Pacific? It’s in Singapore and just a few hops away from most Philippine based ISPs.

    Do I sound like a salesman now?

  2. Avatar for Jhunz Jhunz says:

    For those who want a blog site. Please let me know. If you want a domain and a hosting I can help you with this with or w/out credit card. Php2500 annual for a blog site is not to much..

  3. Avatar for Jhunz Jhunz says:

    Good to know that high traffic blogging needs you to have a server optimization. Actually server optimization is kinda hard thing to do. But if you have an experience doing some linux server installation and configuration it will be fine..

Leave a Reply

Your email address will not be published. Required fields are marked *