Jacob Kaplan-Moss

Waiting for 8.5 – Hot Standby

A first look at hot standby (a.k.a. read slaves) will work in PostgreSQL 8.5. Mark my words: 8.5 is going to be a watershed moment for PostgreSQL.

(databases, postgresql, postgresql8.5, scaling)

IP Failover - Setup and Installing Heartbeat - The Rackspace Cloud — Cloud Servers Knowledge Base

A good explanation of setting up simple IP failover with Heartbeat and HAproxy.

(failover, haproxy, heartbeat, performance, redundancy, scaling, sysadmin)

Digg the Blog » Blog Archive » Looking to the future with Cassandra

A great Cassandra success story from Digg (76 billion columns, 3 TB, sub-second updates). I'm looking forward to the opportunity to use Cassandra myself.

(cassandra, database, digg, nosql, production, programming, scalability, scaling)

Some Notes on Distributed Key Stores « random($foo)

I really have to find the time to check out Tokyo Cabinet.

(datastores, keyvalue, scaling, tokyocabinet)

lwqueue: Lightweight cross-language message queue system

A stab at a memcached-like message queue. Looks super-simple, and 1000 op/s isn't half shabby.

(code, distributed, messaging, programming, python, queue, scaling)

Google Scalability Conference Trip Report: MapReduce, BigTable, and Other Distributed System Abstractions for Handling Large Datasets

More details (than I've seen so far) on the Google architecture. If I'm doing my math right, the data given here tells us that Google has around 25 exa(10^18)bytes.

(architecture, bigtable, gfs, google, mapreduce, scaling)

Rapid development serving 500,000 pages/hour at DavidCramer.net

Curse (powered by Django) handles 500k hits/hour and doesn't sweat.

(django, scaling)

Wikipedia: Site internals, configuration, code examples and management issues (PDF)

Loads of information about the tech behind Wikipedia. I've become convinced that the only sane way to design scalable systems is by studying the trials and tribulations of others.

(architecture, for:jdunck, hardware, infrastructure, lighttpd, memcached, mysql, performance, scaling, sysadmin, via:simonw, web, webdev, wikipedia)

Peter Van Dijck’s Guide to Ease » Blog Archive » The top 10 presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more.

A *great* roundup of ten presentations on scaling: Twitter, Flickr, LiveJournal, Vox, Bloglines, last.fm, and SlideShare.

(deployment, for:jdunck, performance, scaling, server, slides, software, sysadmin, tutorials, webdev)

Ganglia Monitoring System

“Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids.”

(performance, rrd, scaling, statistics, stats, sysadmin, tools, visualization, web)

Kitchen Soap » Blog Archive » Slides from ‘Capacity Planning for LAMP’ talk at MySQL Conf 2007

(apache, flickr, for:jdunck, mysql, scaling, slides)

5 Question Interview with Twitter Developer Alex Payne

“All the convenience methods and syntactical sugar that makes Rails such a pleasure for coders ends up being absolutely punishing, performance-wise.” That, right there, is why Django is written the way it is.

(django, for:holovaty, performance, quotes, rails, ruby, scaling)

Projects at OmniTI Labs

Some open source bits from Theo Schlossnagel & co. Worth keeping an eye on, for sure.

(opensource, scaling, software, via:jdunck)