Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Error when processing messages in Windows


Copy link to this message
-
Error when processing messages in Windows
Hi all,

I've tried pushing a large amount of messages into Kafka on Windows, and
got the following error:

Caused by: java.io.IOException: The requested operation cannot be performed
on a
 file with a user-mapped section open
        at java.io.RandomAccessFile.setLength(Native Method)
        at kafka.log.OffsetIndex.liftedTree2$1(OffsetIndex.scala:263)
        at kafka.log.OffsetIndex.resize(OffsetIndex.scala:262)
        at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:247)
        at kafka.log.Log.rollToOffset(Log.scala:518)
        at kafka.log.Log.roll(Log.scala:502)
        at kafka.log.Log.maybeRoll(Log.scala:484)
        at kafka.log.Log.append(Log.scala:297)
        ... 19 more

I suspect that Windows is not releasing memory mapped file references soon
enough.

I wonder if there is any good workaround or solutions for this?

Thanks!

Tim

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB