Hi All,

I am new to Apache Kafka. I am facing an issue while starting the producer.

kafka.common.LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0

        at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
        at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
        at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)

I have tried hard to find out. But I am unable to find the solution.

So, Please help me to out.

Thanks in advance.

Regards
J. Prasanna Kumar
 

That means the leader for partition [test, 0] is currently unavailable and
ideally should be under another leader election. Do you see a lot of these
errors ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am new to Apache Kafka. I am facing an issue while starting the producer.
>
> kafka.common.LeaderNotAvailableException: Leader not local for topic test
> partition 0 on broker 0
>
>         at
> kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
>         at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
>         at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
>         at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>
> I have tried hard to find out. But I am unable to find the solution.
>
> So, Please help me to out.
>
> Thanks in advance.
>
> Regards
> J. Prasanna Kumar

 

Hi,

I am running zookeeper in stand alone mode only. There is only partition in
there. So no chance for leader election. I am getting the following error in
zookeeper console.

Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
Error Path:/brokers/topics/test1/partitions/0 Error:KeeperErrorCode = NoNode
for /brokers/topics/test1/partitions/0
(org.apache.zookeeper.server.PrepRequestProcessor)

Please help me to sort this out.

Thanks,
Prasanna

-----Original Message-----
From: Neha Narkhede
Sent: Wednesday, January 23, 2013 10:07 PM
To: [EMAIL PROTECTED]
Subject: Re: LeaderNotAvailable Exception

That means the leader for partition [test, 0] is currently unavailable and
ideally should be under another leader election. Do you see a lot of these
errors ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am new to Apache Kafka. I am facing an issue while starting the
> producer.
>
> kafka.common.LeaderNotAvailableException: Leader not local for topic test
> partition 0 on broker 0
>
>         at
> kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
>         at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
>         at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
>         at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>
> I have tried hard to find out. But I am unable to find the solution.
>
> So, Please help me to out.
>
> Thanks in advance.
>
> Regards
> J. Prasanna Kumar

 

Prasanna,

This log message is expected to appear once. Do you see it more than once
in your logs ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am running zookeeper in stand alone mode only. There is only partition
> in there. So no chance for leader election. I am getting the following
> error in zookeeper console.
>
> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
> Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode =
> NoNode for /brokers/topics/test1/**partitions/0
> (org.apache.zookeeper.server.**PrepRequestProcessor)
>
> Please help me to sort this out.
>
> Thanks,
> Prasanna
>
> -----Original Message----- From: Neha Narkhede
> Sent: Wednesday, January 23, 2013 10:07 PM
> To: [EMAIL PROTECTED]
> Subject: Re: LeaderNotAvailable Exception
>
>
> That means the leader for partition [test, 0] is currently unavailable and
> ideally should be under another leader election. Do you see a lot of these
> errors ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
> [EMAIL PROTECTED]> wrote:
>
>  Hi All,
>>
>> I am new to Apache Kafka. I am facing an issue while starting the
>> producer.
>>
>> kafka.common.**LeaderNotAvailableException: Leader not local for topic
>> test
>> partition 0 on broker 0
>>
>>         at
>> kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
>> ReplicaManager.scala:168)
>>         at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:423)
>>         at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:418)
>>         at
>> scala.collection.**TraversableLike$$anonfun$map$**
>> 1.apply(TraversableLike.scala:**206)
>>
>> I have tried hard to find out. But I am unable to find the solution.
>>
>> So, Please help me to out.
>>
>> Thanks in advance.
>>
>> Regards
>> J. Prasanna Kumar
>>
>
>
>

 

Hi Neha,

On zookeeper console it is appearing only once. But in Kafka - server
console I am getting the following exception continuously when ever
application tries to send some request.

kafka.common.LeaderNotAvailableException: Leader not local for topic test2
partition 0 on broker 0
        at
kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
        at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:271)
        at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:266)
        at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
        at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
        at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)

Is this related to zookeeper or kafka? I am trying to electing leader
manually but I am not able to do it.

Any basic thing I am missing?

Thanks
Prasanna
-----Original Message-----
From: Neha Narkhede
Sent: Thursday, January 24, 2013 10:10 AM
To: [EMAIL PROTECTED]
Subject: Re: LeaderNotAvailable Exception

Prasanna,

This log message is expected to appear once. Do you see it more than once
in your logs ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am running zookeeper in stand alone mode only. There is only partition
> in there. So no chance for leader election. I am getting the following
> error in zookeeper console.
>
> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
> Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode =
> NoNode for /brokers/topics/test1/**partitions/0
> (org.apache.zookeeper.server.**PrepRequestProcessor)
>
> Please help me to sort this out.
>
> Thanks,
> Prasanna
>
> -----Original Message----- From: Neha Narkhede
> Sent: Wednesday, January 23, 2013 10:07 PM
> To: [EMAIL PROTECTED]
> Subject: Re: LeaderNotAvailable Exception
>
>
> That means the leader for partition [test, 0] is currently unavailable and
> ideally should be under another leader election. Do you see a lot of these
> errors ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
> [EMAIL PROTECTED]> wrote:
>
>  Hi All,
>>
>> I am new to Apache Kafka. I am facing an issue while starting the
>> producer.
>>
>> kafka.common.**LeaderNotAvailableException: Leader not local for topic
>> test
>> partition 0 on broker 0
>>
>>         at
>> kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
>> ReplicaManager.scala:168)
>>         at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:423)
>>         at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:418)
>>         at
>> scala.collection.**TraversableLike$$anonfun$map$**
>> 1.apply(TraversableLike.scala:**206)
>>
>> I have tried hard to find out. But I am unable to find the solution.
>>
>> So, Please help me to out.
>>
>> Thanks in advance.
>>
>> Regards
>> J. Prasanna Kumar
>>
>
>
>

 

That seems like a bug. Would you mind filing a JIRA and explaining your
test there so we can reproduce and fix the issue ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi Neha,
>
> On zookeeper console it is appearing only once. But in Kafka - server
> console I am getting the following exception continuously when ever
> application tries to send some request.
>
> kafka.common.**LeaderNotAvailableException: Leader not local for topic
> test2 partition 0 on broker 0
>        at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
> ReplicaManager.scala:168)
>        at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:271)
>        at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:266)
>        at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
>        at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
>        at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105)
>
> Is this related to zookeeper or kafka? I am trying to electing leader
> manually but I am not able to do it.
>
> Any basic thing I am missing?
>
> Thanks
>
> Prasanna
>
>
> -----Original Message----- From: Neha Narkhede
> Sent: Thursday, January 24, 2013 10:10 AM
>
> To: [EMAIL PROTECTED]
> Subject: Re: LeaderNotAvailable Exception
>
> Prasanna,
>
> This log message is expected to appear once. Do you see it more than once
> in your logs ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
> [EMAIL PROTECTED]> wrote:
>
>  Hi,
>>
>> I am running zookeeper in stand alone mode only. There is only partition
>> in there. So no chance for leader election. I am getting the following
>> error in zookeeper console.
>>
>> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
>> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
>> Error Path:/brokers/topics/test1/****partitions/0 Error:KeeperErrorCode =
>> NoNode for /brokers/topics/test1/****partitions/0
>> (org.apache.zookeeper.server.****PrepRequestProcessor)
>>
>>
>> Please help me to sort this out.
>>
>> Thanks,
>> Prasanna
>>
>> -----Original Message----- From: Neha Narkhede
>> Sent: Wednesday, January 23, 2013 10:07 PM
>> To: [EMAIL PROTECTED]
>> Subject: Re: LeaderNotAvailable Exception
>>
>>
>> That means the leader for partition [test, 0] is currently unavailable and
>> ideally should be under another leader election. Do you see a lot of these
>> errors ?
>>
>> Thanks,
>> Neha
>>
>>
>> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
>> [EMAIL PROTECTED]> wrote:
>>
>>  Hi All,
>>
>>>
>>> I am new to Apache Kafka. I am facing an issue while starting the
>>> producer.
>>>
>>> kafka.common.****LeaderNotAvailableException: Leader not local for topic
>>>
>>> test
>>> partition 0 on broker 0
>>>
>>>         at
>>> kafka.server.ReplicaManager.****getLeaderReplicaIfLocal(**
>>> ReplicaManager.scala:168)
>>>         at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:423)
>>>         at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:418)
>>>         at
>>> scala.collection.****TraversableLike$$anonfun$map$****
>>> 1.apply(TraversableLike.scala:****206)
>>>
>>>
>>> I have tried hard to find out. But I am unable to find the solution.
>>>
>>> So, Please help me to out.
>>>
>>> Thanks in advance.
>>>
>>> Regards
>>> J. Prasanna Kumar
>>>
>>>
>>
>>
>>
>
>

 

Hi Neha,

Previously I have tried with trunk branch. After I have tried with 0.7
stable version. Now I am able to run some samples.

Thanks for your immediate responses.

I have only one small doubt. Can we set requests to be consumed by only one
consumer, means like a pull operation. Once consumed it shouldn't be
available for other consumers. Is this possible?

I am very new to kafka, that's why I am asking this.

Thanks in advance.

Thanks,
PrasannaKumar.
-----Original Message-----
From: Neha Narkhede
Sent: Thursday, January 24, 2013 10:46 AM
To: [EMAIL PROTECTED]
Subject: Re: LeaderNotAvailable Exception

That seems like a bug. Would you mind filing a JIRA and explaining your
test there so we can reproduce and fix the issue ?

Thanks,
Neha
On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam <
[EMAIL PROTECTED]> wrote:

> Hi Neha,
>
> On zookeeper console it is appearing only once. But in Kafka - server
> console I am getting the following exception continuously when ever
> application tries to send some request.
>
> kafka.common.**LeaderNotAvailableException: Leader not local for topic
> test2 partition 0 on broker 0
>        at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
> ReplicaManager.scala:168)
>        at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:271)
>        at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:266)
>        at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
>        at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
>        at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105)
>
> Is this related to zookeeper or kafka? I am trying to electing leader
> manually but I am not able to do it.
>
> Any basic thing I am missing?
>
> Thanks
>
> Prasanna
>
>
> -----Original Message----- From: Neha Narkhede
> Sent: Thursday, January 24, 2013 10:10 AM
>
> To: [EMAIL PROTECTED]
> Subject: Re: LeaderNotAvailable Exception
>
> Prasanna,
>
> This log message is expected to appear once. Do you see it more than once
> in your logs ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
> [EMAIL PROTECTED]> wrote:
>
>  Hi,
>>
>> I am running zookeeper in stand alone mode only. There is only partition
>> in there. So no chance for leader election. I am getting the following
>> error in zookeeper console.
>>
>> Got user-level KeeperException when processing
>> sessionid:0x13c6ace526d0000
>> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
>> Error Path:/brokers/topics/test1/****partitions/0 Error:KeeperErrorCode =
>> NoNode for /brokers/topics/test1/****partitions/0
>> (org.apache.zookeeper.server.****PrepRequestProcessor)
>>
>>
>> Please help me to sort this out.
>>
>> Thanks,
>> Prasanna
>>
>> -----Original Message----- From: Neha Narkhede
>> Sent: Wednesday, January 23, 2013 10:07 PM
>> To: [EMAIL PROTECTED]
>> Subject: Re: LeaderNotAvailable Exception
>>
>>
>> That means the leader for partition [test, 0] is currently unavailable
>> and
>> ideally should be under another leader election. Do you see a lot of
>> these
>> errors ?
>>
>> Thanks,
>> Neha
>>
>>
>> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
>> [EMAIL PROTECTED]> wrote:
>>
>>  Hi All,
>>
>>>
>>> I am new to Apache Kafka. I am facing an issue while starting the
>>> producer.
>>>
>>> kafka.common.****LeaderNotAvailableException: Leader not local for topic
>>>
>>> test
>>> partition 0 on broker 0
>>>
>>>         at
>>> kafka.server.ReplicaManager.****getLeaderReplicaIfLocal(**
>>> ReplicaManager.scala:168)
>>>         at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:423)
>>>         at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:418)
>>>         at
>>> scala.collection.****TraversableLike$$anonfun$map$****
>>> 1.apply(TraversableLike.scala:****206)

 

> I have only one small doubt. Can we set requests to be consumed by only
> one consumer, means like a pull operation. Once consumed it shouldn't be
> available for other consumers. Is this possible?
It seems you want the data in a topic to be consumed by multiple consumers
in a mutually exclusive way. Kafka offers this via consumer groups using
the zookeeper based consumer. The consumers in a consumer group pull data
from the configured topics in a way that, at a time, no two consumers get
the same data.

Thanks,
Neha

 

I tried to run the kafka 0.8 version as instructed in Quick Start. The kafka server shows the following message when I launch the producer.  ERROR Error while fetching metadata for partition [test,0] (kafka.admin.AdminUtils$)
kafka.common.LeaderNotAvailableException: No leader exists for partition 0
        at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:219)
        at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:201)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
        at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61)
        at scala.collection.immutable.List.foreach(List.scala:45)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
        at scala.collection.immutable.List.map(List.scala:45)
        at kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFromZk(AdminUtils.scala:201)
        at kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:190)
        at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:479)
        at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(KafkaApis.scala:465)
        at scala.collection.immutable.Set$Set1.foreach(Set.scala:81)
        at kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:464)
        at kafka.server.KafkaApis.handle(KafkaApis.scala:67)
        at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
        at java.lang.Thread.run(Unknown Source) Then, when I type a message in the producer console, the server console pops out  WARN [KafkaApi-0] Leader not local for topic test partition 0 on broker 0 (kafka.server.KafkaApis) Consumer console also didn't get any message. Any help is appreciated. Thanks