The configs look reasonable. Currently, we don't repartition existing data.
Only new messages will consider the newly added partitions.
On Mon, Nov 19, 2012 at 9:34 AM, Muthukumar <[EMAIL PROTECTED]> wrote:
> We're currently having 1 broker to 10 consumers setup pointing to 5 ZK
> node. Load would be in 500GB data / day, and following is the generic
> configuration we're using as,
> 1) Please let us know if this configuration is holds good or needs a
> 2) We're seeing a huge backlog of 320GB for topic6 partitioned for 46.
> Is it possible to re-partition since 21 partition were newly added and
> data lag is almost 0 there.
> Let me know if more details are required. And thanks for your great help.