Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Connection reset by peer


Copy link to this message
-
Connection reset by peer
In kafka 0.7.2, I use a producer to send 200 million message to kafka
server.

After sent 100 million this exception happend:

In producer:

Exception in thread "main" java.io.IOException: Connection reset by peer
    at sun.nio.ch.FileDispatcher.writev0(Native Method)
    at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51)
    at sun.nio.ch.IOUtil.write(IOUtil.java:182)
    at sun.nio.ch.SocketChannelImpl.write0(SocketChannelImpl.java:383)
    at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:406)
    at java.nio.channels.SocketChannel.write(SocketChannel.java:384)
    at
kafka.network.BoundedByteBufferSend.writeTo(BoundedByteBufferSend.scala:49)
    at kafka.network.Send$class.writeCompletely(Transmission.scala:73)
    at
kafka.network.BoundedByteBufferSend.writeCompletely(BoundedByteBufferSend.scala:25)
    at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:95)
    at kafka.producer.SyncProducer.send(SyncProducer.scala:94)
    at kafka.producer.SyncProducer.send(SyncProducer.scala:125)
    at
kafka.producer.ProducerPool$$anonfun$send$1.apply$mcVI$sp(ProducerPool.scala:114)
    at
kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100)
    at
kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100)
    at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57)
    at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
    at kafka.producer.ProducerPool.send(ProducerPool.scala:100)
    at kafka.producer.Producer.zkSend(Producer.scala:137)
    at kafka.producer.Producer.send(Producer.scala:99)
    at kafka.javaapi.producer.Producer.send(Producer.scala:103)
In kafka server:

[2013-03-16 06:59:49,491] ERROR Closing socket for /10.2.201.201 because of
error (kafka.network.Processor)
java.io.IOException: Connection reset by peer
    at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
    at
sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:456)
    at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:557)
    at kafka.message.FileMessageSet.writeTo(FileMessageSet.scala:102)
    at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:53)
    at kafka.network.MultiSend.writeTo(Transmission.scala:91)
    at kafka.network.Processor.write(SocketServer.scala:339)
    at kafka.network.Processor.run(SocketServer.scala:216)
    at java.lang.Thread.run(Thread.java:679)

Have you ever seen this exception before, what's the root cause? Thanks

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB