We have 3 brokers in a cluster. The replication factor is 2. I set the default retention size to 3G bytes. I published 12G data to a topic, which is enough to fully load all partitions. I assume on each broker the partition size should be 3G. However, it is only 1.4G for one partation. Is this a known issue? Thanks.
Are you on 0.8 branch or trunk? Also, what are the sizes for the other partitions? Also how many producers do you have? It could be because the producer sticks to a partition for the metadata refresh period - so if your test run isn't long enough some partitions may be more loaded than the others.
On Thu, Nov 21, 2013 at 06:28:39PM +0000, Yu, Libo wrote: