Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> FileChannel error on Flume 1.3.1


Copy link to this message
-
Re: FileChannel error on Flume 1.3.1
Yes that err looks odd so I'd like have a look if possible.  

--
Brock Noland
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Saturday, February 2, 2013 at 4:50 PM, Rahul Ravindran wrote:

> Hi,
>   No, I did not delete the checkpoint previously. That is what I did to fix the problem.
>
> Searching through the archives, it looks like http://mail-archives.apache.org/mod_mbox/flume-user/201211.mbox/%[EMAIL PROTECTED]%3E needs the checkpoint to be deleted. Will do that in future. Do you still need the logs?
> ~Rahul.
>
> From: Brock Noland <[EMAIL PROTECTED]>
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; Rahul Ravindran <[EMAIL PROTECTED]>
> Sent: Saturday, February 2, 2013 2:32 PM
> Subject: Re: FileChannel error on Flume 1.3.1
>
> Hi,
>
> That isn't a good error message. Could you share your entire log file? Post it on a JIRA or pastebin.
>
> Did you delete the checkpoint before starting the channel after changing capacity? Capacity is fixed for the file channel as such the checkpoint must be deleted to change the capacity.  
>
> Brock
>
> On Saturday, February 2, 2013, Rahul Ravindran wrote:
> > Hi,
> >   I increased the capacity and the max file size parameters of the filechannel in our config and began seeing the below exception. I continue seeing the below on restarting the channel. I fixed this by removing the files in the checkpoint and data folders.
> >
> > 02 Feb 2013 21:45:51,113 WARN  [SinkRunner-PollingRunner-LoadBalancingSinkProcessor] (org.apache.flume.sink.LoadBalancingSinkProcessor.process:158)  - Sink failed to consume event. Attempting next sink if available.
> > java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to java.io.EOFException: null
> > at org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
> > at org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
> > at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
> > at org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
> > at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.io.EOFException
> > at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
> > at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
> > at org.apache.flume.channel.file.Log.replay(Log.java:365)
> > at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
> > at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
> > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
> > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >
> >
> >
>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
>
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB