Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> NullPointerException : (Channel closed) on writeCheckpoint


Copy link to this message
-
NullPointerException : (Channel closed) on writeCheckpoint
Hi flume :

I've setup a file to file source/sink , just as a test.  Im using the exec
source, with tail -F to follow a simple tmp file that is being catted to.

However, I've started seeing the following exception in the flume logs:

java.lang.
IllegalStateException: Channel closed [channel=c1]. Due to
java.lang.NullPointerException: null
    at
org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
    at
org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
    at
org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:183)
    at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
    at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
    at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NullPointerException
    at org.apache.flume.channel.file.Log.writeCheckpoint(Log.java:895)
    at org.apache.flume.channel.file.Log.replay(Log.java:406)
    at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
    at
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
    at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
    at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
    at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
    at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
    at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
    ... 1 more

Any thoughts on where this NullPointerException is coming from?  It appears
from scanning the code that maybe it related to a missing folder or
directory.  But I cant find the exact line on the git hub branches.

This is using apache-flume-1.3.1.23-...
--
Jay Vyas
http://jayunit100.blogspot.com
+
Alexander Alten-Lorenz 2013-05-12, 12:57
+
Jay Vyas 2013-05-12, 23:13
+
Jay Vyas 2013-05-13, 15:11
+
Brock Noland 2013-05-13, 15:39
+
Jay Vyas 2013-05-13, 15:53
+
Jay Vyas 2013-05-13, 15:58
+
Brock Noland 2013-05-13, 16:16