Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - kafka-reassign-partitions.sh --status-check-json-file not working


Copy link to this message
-
Re: kafka-reassign-partitions.sh --status-check-json-file not working
Neha Narkhede 2013-11-05, 04:53
Joe,

Could you try -
bin/kafka-reassign-partitions.sh --topics-to-move-json-file
topics-to-move.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

Store the partition assignment output in a file partition-assignment.json,
then use that to execute the assignment -
bin/kafka-reassign-partitions.sh --manual-assignment-json-file
partition-assignment.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

Then check the status using the same file -
bin/kafka-reassign-partitions.sh --status-check-json-file
partition-assignment.json --zookeeper
zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"

I think the reassign partitions command could be improved.

Thanks,
Neha
On Mon, Nov 4, 2013 at 3:41 PM, Guozhang Wang <[EMAIL PROTECTED]> wrote:

> Hello Joe,
>
> Do you see any exceptions in the controller or state-change logs?
>
> Where are these two topics originally located?
>
> Guozhang
>
>
> On Mon, Nov 4, 2013 at 9:47 AM, Joseph Lawson <[EMAIL PROTECTED]> wrote:
>
> > Hi everyone,
> >
> > I'm using Kafka 0.8.0 from the git repository.
> >
> > I'm trying the following commands:
> >
> > bin/kafka-reassign-partitions.sh --topics-to-move-json-file
> > topics-to-move.json --zookeeper
> > zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa --broker-list "1"
> > --execute
> >
> > where topics-to-move.json is:
> >
> > {"topics":
> >      [{"topic": "topic1"},{"topic": "topic2"}],
> >      "version":1
> > }
> >
> > When I run:
> >
> > bin/kafka-reassign-partitions.sh --status-check-json-file
> > topics-to-move.json --zookeeper
> > zk-qa.us-e.roomkey.net:2181/kafka_stage/kafka_qa
> >
> > All I see is:
> >
> > Status of partition reassignment:
> >
> > I expect to see some status but I cannot see anything.
> >
> > When I run the reassign command again I get the following error implying
> > that the reassignment is taking place:
> >
> > Partitions reassignment failed due to Partition reassignment currently in
> > progress for Map(). Aborting operation
> > kafka.common.AdminCommandFailedException: Partition reassignment
> currently
> > in progress for Map(). Aborting operation
> > at
> >
> kafka.admin.ReassignPartitionsCommand.reassignPartitions(ReassignPartitionsCommand.scala:195)
> > at
> >
> kafka.admin.ReassignPartitionsCommand$.main(ReassignPartitionsCommand.scala:137)
> > at
> >
> kafka.admin.ReassignPartitionsCommand.main(ReassignPartitionsCommand.scala)
> >
> >
> > When I look at the broker 1, I see nothing indicating that anything is
> > happening.  I only have a replication factor of 1 on this topic.
> >
> > Is this a bug or am I doing this wrong?
> >
> > Thanks!
> >
> > Joe Lawson
> >
>
>
>
> --
> -- Guozhang
>