Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Error when processing messages in Windows


Copy link to this message
-
Error when processing messages in Windows
Hi all,

I've tried pushing a large amount of messages into Kafka on Windows, and
got the following error:

Caused by: java.io.IOException: The requested operation cannot be performed
on a
 file with a user-mapped section open
        at java.io.RandomAccessFile.setLength(Native Method)
        at kafka.log.OffsetIndex.liftedTree2$1(OffsetIndex.scala:263)
        at kafka.log.OffsetIndex.resize(OffsetIndex.scala:262)
        at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:247)
        at kafka.log.Log.rollToOffset(Log.scala:518)
        at kafka.log.Log.roll(Log.scala:502)
        at kafka.log.Log.maybeRoll(Log.scala:484)
        at kafka.log.Log.append(Log.scala:297)
        ... 19 more

I suspect that Windows is not releasing memory mapped file references soon
enough.

I wonder if there is any good workaround or solutions for this?

Thanks!

Tim

 
+
Jun Rao 2013-07-09, 14:56
+
Denny Lee 2013-07-09, 16:00
+
Jun Rao 2013-07-10, 04:04
+
Jay Kreps 2013-07-10, 04:54
+
Jun Rao 2013-07-10, 14:55
+
Denny Lee 2013-07-10, 15:00
+
Jay Kreps 2013-07-10, 16:34
+
Jun Rao 2013-07-11, 05:30
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB