James Hamilton gave an excellent talk overviewing the 2010 state of the art in scaling datacenters. It starts off a bit rocky, feel free to skip past his meandering prologue to the meat.