Kafka, mail # user - Re: Connection reset by peer - 2013-03-21, 04:26
 Search Hadoop and all its subprojects:
Copy link to this message
-
Re: Connection reset by peer
Hi Jun,

I didn't find any error in producer log.
I did another test,  first I injected data to kafka server, then stop
producer, and start consumer.
The exception still happened, so the exception is not related with producer.

From the log below,  it seems consumer exception happened first.
*
Exceptions in consumers:*

2013/03/21* 12:07:17.940 *INFO [SimpleConsumer] [] Reconnect in multifetch
due to socket error:
java.nio.channels.ClosedByInterruptException
        at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:201)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:281)
        at kafka.utils.Utils$.read(Utils.scala:538)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at kafka.network.Receive$class.readCompletely(Transmission.scala:55)
        at
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at
kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:177)
        at
kafka.consumer.SimpleConsumer.liftedTree2$1(SimpleConsumer.scala:117)
        at
kafka.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:115)
        at kafka.consumer.FetcherRunnable.run(FetcherRunnable.scala:60)

2013/03/21* 12:07:18.176* INFO [SimpleConsumer] [] Reconnect in multifetch
due to socket error:
java.nio.channels.ClosedByInterruptException
        at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:201)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:281)
        at kafka.utils.Utils$.read(Utils.scala:538)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:67)
        at kafka.network.Receive$class.readCompletely(Transmission.scala:55)
        at
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at
kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:177)
        at
kafka.consumer.SimpleConsumer.liftedTree2$1(SimpleConsumer.scala:117)
        at
kafka.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:115)
        at kafka.consumer.FetcherRunnable.run(FetcherRunnable.scala:60)
*Exceptions in kafka server:*

 [2013-03-21 *12:07:18,128*] ERROR Closing socket for /127.0.0.1 because of
error (kafka.network.Processor)
 java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
        at
sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:456)
        at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:557)
        at kafka.message.FileMessageSet.writeTo(FileMessageSet.scala:102)
        at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:53)
        at kafka.network.MultiSend.writeTo(Transmission.scala:91)
        at kafka.network.Processor.write(SocketServer.scala:339)
        at kafka.network.Processor.run(SocketServer.scala:216)
        at java.lang.Thread.run(Thread.java:679)
[2013-03-21 *12:07:19,263*] INFO Socket connection established to localhost/
127.0.0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
 [2013-03-21* 12:07:18,055*] ERROR Closing socket for /127.0.0.1 because of
error (kafka.network.Processor)
 java.io.IOException: Broken pipe
        at sun.nio.ch.FileDispatcher.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:122)
        at sun.nio.ch.IOUtil.write(IOUtil.java:93)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:352)
        at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:51)
        at kafka.network.MultiSend.writeTo(Transmission.scala:91)
        at kafka.network.Processor.write(SocketServer.scala:339)
        at kafka.network.Processor.run(SocketServer.scala:216)
        at java.lang.Thread.run(Thread.java:679)

*
*

2013/3/20 Jun Rao <[EMAIL PROTECTED]>
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB