Search Hadoop and all its sub project:

Switch to Threaded View
Subject: Re: Is there a way to delete partition at runtime?
Hi Marc,

Having a different set of metadata stored on the brokers to feed metadata
requests from producers and consumers would be very tricky I think. For
your use case, one thing you could try is use a customized partitioning
function in the producer to only produce to a subset of the partitions
depending on the traffic, and partitions that do not have any data coming
in will eventually delete all the logs of the partition on that broker,
hence effectively reduce the file handlers for both the logs and the

On Tue, Jan 28, 2014 at 12:53 PM, Marc Labbe <[EMAIL PROTECTED]> wrote:

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB