Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> kafka-reassign-partitions.sh --status-check-json-file not working


Copy link to this message
-
Re: kafka-reassign-partitions.sh --status-check-json-file not working
Joe,

Could you try -
bin/kafka-reassign-partitions.sh --topics-to-move-json-file
topics-to-move.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

Store the partition assignment output in a file partition-assignment.json,
then use that to execute the assignment -
bin/kafka-reassign-partitions.sh --manual-assignment-json-file
partition-assignment.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

Then check the status using the same file -
bin/kafka-reassign-partitions.sh --status-check-json-file
partition-assignment.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

I think the reassign partitions command could be improved.

Thanks,
Neha
On Mon, Nov 4, 2013 at 3:41 PM, Guozhang Wang <[EMAIL PROTECTED]> wrote:

> Hello Joe,
>
> Do you see any exceptions in the controller or state-change logs?
>
> Where are these two topics originally located?
>
> Guozhang
>
>
> On Mon, Nov 4, 2013 at 9:47 AM, Joseph Lawson <[EMAIL PROTECTED]> wrote:
>
> > Hi everyone,
> >
> > I'm using Kafka 0.8.0 from the git repository.
> >
> > I'm trying the following commands:
> >
> > bin/kafka-reassign-partitions.sh --topics-to-move-json-file
> > topics-to-move.json --zookeeper
> > zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"
> > --execute
> >
> > where topics-to-move.json is:
> >
> > {"topics":
> >      [{"topic": "topic1"},{"topic": "topic2"}],
> >      "version":1
> > }
> >
> > When I run:
> >
> > bin/kafka-reassign-partitions.sh --status-check-json-file
> > topics-to-move.json --zookeeper
> > zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa
> >
> > All I see is:
> >
> > Status of partition reassignment:
> >
> > I expect to see some status but I cannot see anything.
> >
> > When I run the reassign command again I get the following error implying
> > that the reassignment is taking place:
> >
> > Partitions reassignment failed due to Partition reassignment currently in
> > progress for Map(). Aborting operation
> > kafka.common.AdminCommandFailedException: Partition reassignment
> currently
> > in progress for Map(). Aborting operation
> > at
> >
> kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:195)
> > at
> >
> kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:137)
> > at
> >
> kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
> >
> >
> > When I look at the broker 1, I see nothing indicating that anything is
> > happening.  I only have a replication factor of 1 on this topic.
> >
> > Is this a bug or am I doing this wrong?
> >
> > Thanks!
> >
> > Joe Lawson
> >
>
>
>
> --
> -- Guozhang
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB