avocado shake (dot) net

Throttle aggressively (especially the statistics module) to survive the Digg effect

Wise Bread has been very popular on Digg the last few weeks. Every time we get Dugg, the server crawls. We've been making incremental tweaks, but today, we found a tweak that relieved all the pressure at once:

Throttle the statistics module!

It's been said before, but we didn't do it in order to preserve the list of popular today/all-time articles in the sidebar. Everything else we throttled. For previous Diggings, that level of throttling along with making the popular article a static file was just enough to make the site load very slowly. (That's better than when we were getting WSOD or 503 unavailables.)

Today when the number of anonymous users online stayed high (around 1800) for a couple of hours (and the site was unresponsive), we knew more stuff had to go. As soon as we throttled statistics, search and comments, the load on the server dropped to zero. We ended up unthrottling comments and the load was still acceptable, so we'll keep that on. But definitely no more statistics during high load conditions.

Bottom line: If you want your content (at least the article) to be read during a Digging, throttle aggressively. Throw out everything except the article itself if you have to!

Avocado Shake (dot net) is the personal website of Gregory Go, co-founder of Killer Aces Media and Drupal fanboy.

Full text blog feed

My Tumblog

FriendFeed Stream

Essential Skills of a Community Manager
From Google Reader, posted Saturday, July 26, 2008 - 21:12.
Cartoon: Fannie Mae & Freddie Mac
From Mixx, posted Saturday, July 26, 2008 - 21:04.
Essential Skills of a Community Manager
From Google Reader, posted Saturday, July 26, 2008 - 20:24.
Picturing Casualties In Iraq: Slide Show
From Mixx, posted Saturday, July 26, 2008 - 20:20.
Submitted: 19 Tips for Cheering Yourself Up -- From 200 Years Ago
From Mixx, posted Saturday, July 26, 2008 - 20:03.
Submitted: 3 Tips for Losing Weight on a Budget
From Mixx, posted Saturday, July 26, 2008 - 19:50.
Submitted: How to Deal with a Partner That Hides Money Problems
From Mixx, posted Saturday, July 26, 2008 - 18:10.
Blogging's Glass Ceiling (Kara Jesella/New York Times)
From Google Reader, posted Saturday, July 26, 2008 - 18:02.
How to increase submit speed from 45s to a fraction while keeping Akismet anti-spam - Pligg Forum
From del.icio.us, posted Saturday, July 26, 2008 - 17:26.
Lazy Linux: 10 essential tricks for admins
From del.icio.us, posted Saturday, July 26, 2008 - 16:21.