Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Changing the number of partitions after a topic is created


Copy link to this message
-
Re: Changing the number of partitions after a topic is created
Jun Rao 2013-07-09, 03:58
We are shooting for providing a patch in a couple of weeks.

Thanks,

Jun
On Mon, Jul 8, 2013 at 10:33 AM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Hi Jun,
>
> I wonder when will the tool be available? We're very interested in changing
> the number of partitions for a topic after creation too.
>
> Thanks!
>
> Tim
>
>
> On Thu, Jul 4, 2013 at 9:06 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > Currently, once a topic is created, the number of partitions can't be
> > changed. We are working on a tool to allow that. For now, you will have
> to
> > either use a new topic with more partitions or if you don't care about
> > messages being consumed in order, you can feed the consumed messages to a
> > separate thread pool for processing.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Thu, Jul 4, 2013 at 8:11 AM, Calvin Lei <[EMAIL PROTECTED]> wrote:
> >
> > > Hi I have a few topics created with 1 partition. After running the
> > cluster
> > > for a few days, I want to increase the partition to 10 to improve the
> > > consumer throughput. I learnt that it is not supported in 0.8.
> > >
> > > What is the recommendation of improving consumer throughput after a
> topic
> > > is created and the data volume increased?
> > >
> > > Regards,
> > > Cal
> > >
> >
>