Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> [jira] [Closed] (KAFKA-721) FileNotFoundException on index file


Copy link to this message
-
[jira] [Closed] (KAFKA-721) FileNotFoundException on index file

     [ https://issues.apache.org/jira/browse/KAFKA-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neha Narkhede closed KAFKA-721.
-------------------------------

    
> FileNotFoundException on index file
> -----------------------------------
>
>                 Key: KAFKA-721
>                 URL: https://issues.apache.org/jira/browse/KAFKA-721
>             Project: Kafka
>          Issue Type: Bug
>          Components: core, log
>    Affects Versions: 0.8
>            Reporter: Jun Rao
>            Assignee: Jun Rao
>            Priority: Blocker
>              Labels: p1
>
> [2013-01-21 22:01:36,116] INFO [Kafka Log on Broker 1], Rolling log 'topicx-1' to /mnt/u001/kafka_08_long_running_test/kafka-logs/Mo
> bilePageViewEvent-1/00000000000000019578.log and /mnt/u001/kafka_08_long_running_test/kafka-logs/MobilePageViewEvent-1/00000000000000019578.index
>  (kafka.log.Log)
> [2013-01-21 22:01:36,118] ERROR error in loggedRunnable (kafka.utils.Utils$)
> java.io.FileNotFoundException: /mnt/u001/kafka_08_long_running_test/kafka-logs/MobilePageViewEvent-1/00000000000000000000.index (No such file or directory)
>         at java.io.RandomAccessFile.open(Native Method)
>         at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
>         at kafka.log.OffsetIndex.resize(OffsetIndex.scala:244)
>         at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:233)
>         at kafka.log.Log.rollToOffset(Log.scala:473)
>         at kafka.log.Log.roll(Log.scala:457)
>         at kafka.log.Log.markDeletedWhile(Log.scala:411)
>         at kafka.log.LogManager.kafka$log$LogManager$$cleanupExpiredSegments(LogManager.scala:241)
>         at kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:277)
>         at kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:275)
>         at scala.collection.Iterator$class.foreach(Iterator.scala:631)
>         at scala.collection.JavaConversions$JIteratorWrapper.foreach(JavaConversions.scala:474)
>         at scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
>         at scala.collection.JavaConversions$JCollectionWrapper.foreach(JavaConversions.scala:495)
>         at kafka.log.LogManager.cleanupLogs(LogManager.scala:275)
>         at kafka.log.LogManager$$anonfun$startup$1.apply$mcV$sp(LogManager.scala:141)
>         at kafka.utils.Utils$$anon$2.run(Utils.scala:66)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:619)
> Before this, we have the following log that shows an index file is newly created.
> [2013-01-21 22:01:05,920] INFO Partition [MobilePageViewEvent, 1] on broker 1: Starting the follower state transition to follow leader 5 for topic MobilePageViewEvent partition 1 (kafka.cluster.Partition)
> [2013-01-21 22:01:05,920] INFO [ReplicaFetcherManager on broker 1] removing fetcher on topic MobilePageViewEvent, partition 1 (kafka.server.ReplicaFetcherManager)
> [2013-01-21 22:01:05,920] INFO Creating or reloading log segment /mnt/u001/kafka_08_long_running_test/kafka-logs/MobilePageViewEvent-1/00000000000000000000.log (kafka.log.FileMessageSet)
> [2013-01-21 22:01:05,920] INFO Created index file /mnt/u001/kafka_08_long_running_test/kafka-logs/MobilePageViewEvent-1/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 0, lastOffset = 0 (kafka.log.OffsetIndex)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB