Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Error when processing messages in Windows


Copy link to this message
-
Error when processing messages in Windows
Hi all,

I've tried pushing a large amount of messages into Kafka on Windows, and
got the following error:

Caused by: java.io.IOException: The requested operation cannot be performed
on a
 file with a user-mapped section open
        at java.io.RandomAccessFile.setLength(Native Method)
        at kafka.log.OffsetIndex.liftedTree2$1(OffsetIndex.scala:263)
        at kafka.log.OffsetIndex.resize(OffsetIndex.scala:262)
        at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:247)
        at kafka.log.Log.rollToOffset(Log.scala:518)
        at kafka.log.Log.roll(Log.scala:502)
        at kafka.log.Log.maybeRoll(Log.scala:484)
        at kafka.log.Log.append(Log.scala:297)
        ... 19 more

I suspect that Windows is not releasing memory mapped file references soon
enough.

I wonder if there is any good workaround or solutions for this?

Thanks!

Tim

 
+
Jun Rao 2013-07-09, 14:56
+
Denny Lee 2013-07-09, 16:00
+
Jun Rao 2013-07-10, 04:04
+
Jay Kreps 2013-07-10, 04:54
+
Jun Rao 2013-07-10, 14:55
+
Denny Lee 2013-07-10, 15:00
+
Jay Kreps 2013-07-10, 16:34
+
Jun Rao 2013-07-11, 05:30