-
Re: FileChannel error on Flume 1.3.1Brock Noland 2013-02-03, 00:05
Yes that err looks odd so I'd like have a look if possible.
--
Brock Noland
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Saturday, February 2, 2013 at 4:50 PM, Rahul Ravindran wrote:
> Hi,
> No, I did not delete the checkpoint previously. That is what I did to fix the problem.
>
> Searching through the archives, it looks like http://mail-archives.apache.org/mod_mbox/flume-user/201211.mbox/%[EMAIL PROTECTED]%3E needs the checkpoint to be deleted. Will do that in future. Do you still need the logs?
> ~Rahul.
>
> From: Brock Noland <[EMAIL PROTECTED]>
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; Rahul Ravindran <[EMAIL PROTECTED]>
> Sent: Saturday, February 2, 2013 2:32 PM
> Subject: Re: FileChannel error on Flume 1.3.1
>
> Hi,
>
> That isn't a good error message. Could you share your entire log file? Post it on a JIRA or pastebin.
>
> Did you delete the checkpoint before starting the channel after changing capacity? Capacity is fixed for the file channel as such the checkpoint must be deleted to change the capacity.
>
> Brock
>
> On Saturday, February 2, 2013, Rahul Ravindran wrote:
> > Hi,
> > I increased the capacity and the max file size parameters of the filechannel in our config and began seeing the below exception. I continue seeing the below on restarting the channel. I fixed this by removing the files in the checkpoint and data folders.
> >
> > 02 Feb 2013 21:45:51,113 WARN [SinkRunner-PollingRunner-LoadBalancingSinkProcessor] (org.apache.flume.sink.LoadBalancingSinkProcessor.process:158) - Sink failed to consume event. Attempting next sink if available.
> > java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to java.io.EOFException: null
> > at org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
> > at org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
> > at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
> > at org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
> > at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.io.EOFException
> > at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
> > at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
> > at org.apache.flume.channel.file.Log.replay(Log.java:365)
> > at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
> > at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
> > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
> > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >
> >
> >
>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
>
>
--
Brock Noland
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Saturday, February 2, 2013 at 4:50 PM, Rahul Ravindran wrote:
> Hi,
> No, I did not delete the checkpoint previously. That is what I did to fix the problem.
>
> Searching through the archives, it looks like http://mail-archives.apache.org/mod_mbox/flume-user/201211.mbox/%[EMAIL PROTECTED]%3E needs the checkpoint to be deleted. Will do that in future. Do you still need the logs?
> ~Rahul.
>
> From: Brock Noland <[EMAIL PROTECTED]>
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; Rahul Ravindran <[EMAIL PROTECTED]>
> Sent: Saturday, February 2, 2013 2:32 PM
> Subject: Re: FileChannel error on Flume 1.3.1
>
> Hi,
>
> That isn't a good error message. Could you share your entire log file? Post it on a JIRA or pastebin.
>
> Did you delete the checkpoint before starting the channel after changing capacity? Capacity is fixed for the file channel as such the checkpoint must be deleted to change the capacity.
>
> Brock
>
> On Saturday, February 2, 2013, Rahul Ravindran wrote:
> > Hi,
> > I increased the capacity and the max file size parameters of the filechannel in our config and began seeing the below exception. I continue seeing the below on restarting the channel. I fixed this by removing the files in the checkpoint and data folders.
> >
> > 02 Feb 2013 21:45:51,113 WARN [SinkRunner-PollingRunner-LoadBalancingSinkProcessor] (org.apache.flume.sink.LoadBalancingSinkProcessor.process:158) - Sink failed to consume event. Attempting next sink if available.
> > java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to java.io.EOFException: null
> > at org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
> > at org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
> > at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
> > at org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
> > at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.io.EOFException
> > at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
> > at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
> > at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
> > at org.apache.flume.channel.file.Log.replay(Log.java:365)
> > at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
> > at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
> > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
> > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
> > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >
> >
> >
>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
>
>
