Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> [Kafka MirrorMaker] Message with Custom Partition Logic


Copy link to this message
-
Re: [Kafka MirrorMaker] Message with Custom Partition Logic
Bhavesh,

For keyed data, the mirror maker will just distribute data based on
hash(key)%num_partitions. If num_partitions is different in the target DC
(which it is), a message that lived in partition 0 in the source cluster
might end up in partition 10 in the target cluster.

Thanks,
Neha
On Mon, Aug 11, 2014 at 7:23 PM, Bhavesh Mistry <[EMAIL PROTECTED]>
wrote: