Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Partitioning strategies


Copy link to this message
-
Re: Partitioning strategies
Michal,

When partitioning the data, you can put the data in different partitions in
the same topic or different topics. The difference is that in the latter,
the consumer has to manually balance the load across topics.

Thanks,

Jun

On Sat, Nov 3, 2012 at 7:09 AM, Michal Haris <[EMAIL PROTECTED]>wrote:

> Hi,
>
> Would it be reasonable to say that deterministic partotioner should always
> be deciding on attributes with high cardinality?
>
> I.e. with low cardinality some partitions would end up with large volumes
> of messages which could not be scaled horizontally and so in cases like
> that separate topics would be appropriate.
>
> Michal
>