Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: Changing the number of partitions after a topic is created


Copy link to this message
-
Re: Changing the number of partitions after a topic is created
Thanks Neha, that helps.
On Wed, Aug 28, 2013 at 12:59 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> The tool you are looking for is described here -
>
> https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools#Replicationtools-5.AddPartitionCommandTool
> .
>
> Please note that this tool can only increase the number of partitions for a
> topic, there is no tool to reduce the number of partitions yet.
>
> Thanks,
> Neha
>
>
> On Wed, Aug 28, 2013 at 9:54 AM, Rajasekar Elango <[EMAIL PROTECTED]
> >wrote:
>
> > Hi Neha,
> >
> > If we set auto.create.topics.enable = true and update num.partitions. New
> > topic get right number of partitions. But existing topics continue to use
> > whatever num.partitions set before. I am asking about the tool that allow
> > existing topic to use updated number of partitions.
> >
> > Thanks,
> > Raja.
> >
> >
> > On Wed, Aug 28, 2013 at 12:38 PM, Neha Narkhede <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Hi Rajasekar,
> > >
> > > I'm not sure I fully understood your question. Are you asking about a
> > tool
> > > that can increase the number of partitions for a topic?
> > >
> > > Thanks,
> > > Neha
> > >
> > >
> > > On Wed, Aug 28, 2013 at 8:47 AM, Rajasekar Elango <
> > [EMAIL PROTECTED]
> > > >wrote:
> > >
> > > > Hi Jun,
> > > >
> > > > It's been some time since you last post, is this patch available now.
> > > Also
> > > > we are doing following manual steps to update existing topic to use
> new
> > > > partitions.
> > > >
> > > > 1) stop all zookeepers
> > > > 2) stop all kafka brokers
> > > > 3) clean data dir or zookeepers and kafka
> > > > 4) start zookeepers and kafka.
> > > >
> > > > This involves both downtime and loosing data. Is there a better way
> to
> > > > update existing topics to use new partitions until patch is
> > available..?
> > > >
> > > > --
> > > > Thanks,
> > > > Raja.
> > > >
> > >
> >
> >
> >
> > --
> > Thanks,
> > Raja.
> >
>

--
Thanks,
Raja.

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB