This recipe is about implementing custom Parititoner A Partitioner in MapReduce world partitions the key space. The partitioner is used to derive the partition to which a key-value pair belongs. It is responsible for bring records with same key to same partition so that they can be processed together by a reducer. To implement a [...]
This Recipe is about implementing a custom Writable to be used in MapReduce code. Hadoop provides a lot of implementations of Writables out-of-the-box which suffice to most of the cases. However, at time we need to implement custom Objects to be passed. They are the implementations of Hadoop’s Writable interface. Let’s see how to implement [...]
Starting the Hadoop Recipe series, in which I shall pick up a topic and provide sample code around it. Each shall be small and concise, would provide ready to use hints on topics covered. The post covers usage of Custom Counters in Java in Hadoop world. Counters are very helpful in MapReduce world. We can [...]
© Thread.currentThread().join(). Say something clever here. Or not. You decide.
