February 2010
5 posts
http://www.infoq.com/presentations/Facebook-Hive-Ha... →
Informative talk by Ashish Thusoo and Namit Jain from Facebook’s Hive team.
Hive’s RCFile is pretty interesting - it provides record-columnar storage on top of HDFS. Apparently it results in very good compression and higher scan throughput.
http://www.dabeaz.com/GIL/ →
David Beazley continues his GIL investigation work from his ChiPy ‘09 talk. This time he also analyses the new GIL optimizations that are apparently present in the Python 3.2 svn branch. Look at his slides to see how the new GIL performs!
It took surprisingly little amount of code changes to the Python interpreter to do this kind of investigative work (Read more about his code changes). He...
“The spot price of MicroSD cards is nearly identical to the spot price of the...”
– On MicroSD Problems « bunnie’s blog
Fascinating article on the MicroSD industry and the economics involved in manufacturing them by a Chumby engineer. He has a whole series of articles about hardware manufacturing and China.
http://blogs.digitar.com/jjww/2009/01/rabbits-and-w... →
Nice article providing a quick intro to RabbitMQ/AMQP terminology.
Summary:
Virtual hosts - one RabbitMQ server can host multiple virtual hosts (each virtual host maps to one user process). One virtual host can contain multiple exchanges.
Queues - queues hold messages which consumers can consume.
Routing keys - each message has a routing key.
Exchanges - producers drop off messages at...
“REPLACE INTO Tickets64 (stub) VALUES (‘a’);
SELECT LAST_INSERT_ID();”
– Ticket Servers: Distributed Unique Primary Keys on the Cheap - Laughing Meme
Kellan describes the hack they use at Flickr to (atomically) generate globally unique auto-increment ids across shards. Redis would be great for something like this.