Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Kafka server error


Copy link to this message
-
Re: Kafka server error
Jun Rao 2013-10-11, 05:13
I meant the broker crash. Is that reproducible?

Thanks,

Jun
On Thu, Oct 10, 2013 at 10:10 PM, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Yes, everytime, I send message, it throws that error.
>
>
> 2013/10/11 Jun Rao <[EMAIL PROTECTED]>
>
> > Is that reproducible?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Thu, Oct 10, 2013 at 9:54 PM, Jiang Jacky <[EMAIL PROTECTED]>
> wrote:
> >
> > > Yes, it just says "INFO Reconnect due to socket error"
> > > But why and how come it comes? my zookeeper and storm have no any
> problem
> > > to collaborate each other.
> > >
> > >
> > > 2013/10/11 Jun Rao <[EMAIL PROTECTED]>
> > >
> > > > The log you posted for the second broker didn't say why it crashed.
> Is
> > > that
> > > > all you got?
> > > >
> > > > Thanks,
> > > >
> > > > Jun
> > > >
> > > >
> > > > On Thu, Oct 10, 2013 at 9:22 PM, Jiang Jacky <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > *Hi, Guys,*
> > > > > *I am currently running into the kafka server issue. *
> > > > > *I have a 5 nodes cluster and zookeeper running without any
> problem.
> > > > when I
> > > > > manually boot each node by using* "*JMX_PORT=9997
> > > > bin/kafka-server-start.sh
> > > > > config/server-x.properties &*" command.
> > > > >
> > > > > *The scenario is:*
> > > > > *Then, first node, it can be booted.*
> > > > > *Once I boot the second node, it is crashed, the error is below:*
> > > > >
> > > > > [2013-10-11 04:02:17,200] INFO [Replica Manager on Broker 0]:
> > Handling
> > > > > LeaderAndIsr request
> > > > >
> > > > >
> > > >
> > >
> >
> Name:LeaderAndIsrRequest;Version:0;Controller:0;ControllerEpoch:30416;CorrelationId:5;ClientId:id_0-host_null-port_9092;PartitionState:(test-kafka,0)
> > > > > ->
> > > > >
> > > > >
> > > >
> > >
> >
> (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:90,ControllerEpoch:30411),ReplicationFactor:1),AllReplicas:1);Leaders:id:1,host:localhost,port:9092
> > > > > (kafka.server.ReplicaManager)
> > > > > [2013-10-11 04:02:17,204] WARN No previously checkpointed
> > highwatermark
> > > > > value found for topic test-kafka partition 0. Returning 0 as the
> > > > > highwatermark (kafka.server.HighwaterMarkCheckpoint)
> > > > > [2013-10-11 04:02:17,205] INFO [ReplicaFetcherManager on broker 0]
> > > > Removing
> > > > > fetcher for partition [test-kafka,0]
> > > (kafka.server.ReplicaFetcherManager)
> > > > > [2013-10-11 04:02:17,214] INFO [Kafka Log on Broker 0], Truncated
> log
> > > > > segment /tmp/kafka-logs/test-kafka-0/00000000000000000000.log to
> > target
> > > > > offset 0 (kafka.log.Log)
> > > > > [2013-10-11 04:02:17,235] INFO [ReplicaFetcherManager on broker 0]
> > > Adding
> > > > > fetcher for partition [test-kafka,0], initOffset 0 to broker 1 with
> > > > > fetcherId 0 (kafka.server.ReplicaFetcherManager)
> > > > > [2013-10-11 04:02:17,236] INFO [Replica Manager on Broker 0]:
> Handled
> > > > > leader and isr request
> > > > >
> > > > >
> > > >
> > >
> >
> Name:LeaderAndIsrRequest;Version:0;Controller:0;ControllerEpoch:30416;CorrelationId:5;ClientId:id_0-host_null-port_9092;PartitionState:(test-kafka,0)
> > > > > ->
> > > > >
> > > > >
> > > >
> > >
> >
> (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:90,ControllerEpoch:30411),ReplicationFactor:1),AllReplicas:1);Leaders:id:1,host:localhost,port:9092
> > > > > (kafka.server.ReplicaManager)
> > > > > [2013-10-11 04:02:17,240] INFO [ReplicaFetcherThread-0-1], Starting
> > > > >  (kafka.server.ReplicaFetcherThread)
> > > > > [2013-10-11 04:02:17,266] INFO [Replica Manager on Broker 0]:
> > Handling
> > > > > LeaderAndIsr request
> > > > >
> > > > >
> > > >
> > >
> >
> Name:LeaderAndIsrRequest;Version:0;Controller:0;ControllerEpoch:30416;CorrelationId:6;ClientId:id_0-host_null-port_9092;PartitionState:(test-kafka,0)
> > > > > ->
> > > > >
> > > > >
> > > >
> > >
> >
> (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:91,ControllerEpoch:30416),ReplicationFactor:1),AllReplicas:1);Leaders:id:1,host:localhost,port:9092
> > > > > (kafka.server.ReplicaManager)
> > > >