Youtube scalability and what happened to lighttpd 1.5
Mike sent me this link of a Google Tech talk on “Scalability at Youtube”.
Its a interesting read for a number of reasons:
- You Tube had a tiny technical team that built and ran the site.
- They show why the used various webserver configurations – apache vs squid vs lighttpd
- It explains why development of lighttpd 1.5 has stalled. (they developed the code to integrate libaio into lighttpd 1.5 and once they were brought by google they moved to google big table)
- Introduces the concept of database partitioning or shards
Enjoy!