Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Connection reset by peer


Copy link to this message
-
Re: Connection reset by peer
Hi Jun,

I didn't find any error in producer log.
I did another test,  first I injected data to kafka server, then stop
producer, and start consumer.
The exception still happened, so the exception is not related with producer.

From the log below,  it seems consumer exception happened first.
*
Exceptions in consumers:*

2013/03/21* 12:07:17.940 *INFO [SimpleConsumer] [] Reconnect in multifetch
due to socket error:
java.nio.channels.ClosedByInterruptException
        at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:201)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:281)
        at kafka.utils.Utils$.read(Utils.scala:538)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
        at kafka.network.Receive$class.readCompletely(Transmission.scala:55)
        at
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at
kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:177)
        at
kafka.consumer.SimpleConsumer.liftedTree2$1(SimpleConsumer.scala:117)
        at
kafka.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:115)
        at kafka.consumer.FetcherRunnable.run(FetcherRunnable.scala:60)

2013/03/21* 12:07:18.176* INFO [SimpleConsumer] [] Reconnect in multifetch
due to socket error:
java.nio.channels.ClosedByInterruptException
        at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:201)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:281)
        at kafka.utils.Utils$.read(Utils.scala:538)
        at
kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:67)
        at kafka.network.Receive$class.readCompletely(Transmission.scala:55)
        at
kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
        at
kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:177)
        at
kafka.consumer.SimpleConsumer.liftedTree2$1(SimpleConsumer.scala:117)
        at
kafka.consumer.SimpleConsumer.multifetch(SimpleConsumer.scala:115)
        at kafka.consumer.FetcherRunnable.run(FetcherRunnable.scala:60)
*Exceptions in kafka server:*

 [2013-03-21 *12:07:18,128*] ERROR Closing socket for /127.0.0.1 because of
error (kafka.network.Processor)
 java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
        at
sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:456)
        at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:557)
        at kafka.message.FileMessageSet.writeTo(FileMessageSet.scala:102)
        at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:53)
        at kafka.network.MultiSend.writeTo(Transmission.scala:91)
        at kafka.network.Processor.write(SocketServer.scala:339)
        at kafka.network.Processor.run(SocketServer.scala:216)
        at java.lang.Thread.run(Thread.java:679)
[2013-03-21 *12:07:19,263*] INFO Socket connection established to localhost/
127.0.0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
 [2013-03-21* 12:07:18,055*] ERROR Closing socket for /127.0.0.1 because of
error (kafka.network.Processor)
 java.io.IOException: Broken pipe
        at sun.nio.ch.FileDispatcher.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:122)
        at sun.nio.ch.IOUtil.write(IOUtil.java:93)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:352)
        at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:51)
        at kafka.network.MultiSend.writeTo(Transmission.scala:91)
        at kafka.network.Processor.write(SocketServer.scala:339)
        at kafka.network.Processor.run(SocketServer.scala:216)
        at java.lang.Thread.run(Thread.java:679)

*
*

2013/3/20 Jun Rao <[EMAIL PROTECTED]>

> "Connect reset by peer" means the other side of the socket has closed the