KodeKabuki

Welcome, my name is Harish Mallipeddi. I work for Amazon Web Services (AWS). This blog is mostly a dump of interesting articles that I come across on the web. Topics span across multiple areas including algorithms/datastructures, NoSQL stores, database internals, web-scale challenges, and functional languages.

October 22, 2009 at 2:10am

Home

GitHub's new architecture →

Very well written article highlighting the new architecture of GitHub (post-Rackspace move). Every company/team should at least have a similar internal document describing their current architecture at a high-level but unfortunately doesn’t happen in most companies.

GitHub seems to be using a lot of familiar Opensource projects in their stack - Nginx, Ruby/Rails/Unicorn, HAProxy, MySQL, memcached, redis, bunch of RPC services speaking the new BERT/BERT-RPC protocol. The only thing I’ve not really played with yet is DRBD and I’ve heard lots of good things about DRBD from others.

So looks like now you’ve Facebook’s Thrift, Google’s Protocol Buffers, Hadoop/Doug Cutting’s Avro, just plain JSON/XML and GitHub’s BERT for your (de)serialization needs!