Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Add partitions command note


+
Marc Labbe 2014-01-30, 20:26
Copy link to this message
-
Re: Add partitions command note
Yeah this is confusing.

What they are trying to say is that adding partitions doesn't move data
that is already in existing partitions. I.e. say you have 10 partitions
(0-9) each containing 1GB of data and you add an 11th partition. When this
is complete partitions 0-9 will contain the exact same data as before but
there will be an empty partition 10.

This is relevant to people who are partitioning their data by some key or
other semantic feature. If you are partitioning by primary_key %
partition_count and the partition_count changes then your data is now in
the wrong partition. That is what the warning is trying to call out.

-Jay
On Thu, Jan 30, 2014 at 12:26 PM, Marc Labbe <[EMAIL PROTECTED]> wrote:
 
+
Marc Labbe 2014-01-30, 21:54
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB