Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Changing the number of partitions after a topic is created


Copy link to this message
-
Re: Changing the number of partitions after a topic is created
We are shooting for providing a patch in a couple of weeks.

Thanks,

Jun
On Mon, Jul 8, 2013 at 10:33 AM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Hi Jun,
>
> I wonder when will the tool be available? We're very interested in changing
> the number of partitions for a topic after creation too.
>
> Thanks!
>
> Tim
>
>
> On Thu, Jul 4, 2013 at 9:06 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > Currently, once a topic is created, the number of partitions can't be
> > changed. We are working on a tool to allow that. For now, you will have
> to
> > either use a new topic with more partitions or if you don't care about
> > messages being consumed in order, you can feed the consumed messages to a
> > separate thread pool for processing.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Thu, Jul 4, 2013 at 8:11 AM, Calvin Lei <[EMAIL PROTECTED]> wrote:
> >
> > > Hi I have a few topics created with 1 partition. After running the
> > cluster
> > > for a few days, I want to increase the partition to 10 to improve the
> > > consumer throughput. I learnt that it is not supported in 0.8.
> > >
> > > What is the recommendation of improving consumer throughput after a
> topic
> > > is created and the data volume increased?
> > >
> > > Regards,
> > > Cal
> > >
> >
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB