Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Uncaught Exception When Using Spooling Directory Source


Copy link to this message
-
Uncaught Exception When Using Spooling Directory Source
Hi,

When using Spooling Directory Source in Flume NG 1.3.1, this exception
happens:

13/01/18 11:37:09 ERROR source.SpoolDirectorySource: Uncaught exception in
Runnable
java.io.IOException: Stream closed
at java.io.BufferedReader.ensureOpen(BufferedReader.java:97)
at java.io.BufferedReader.readLine(BufferedReader.java:292)
 at java.io.BufferedReader.readLine(BufferedReader.java:362)
at
org.apache.flume.client.avro.SpoolingFileLineReader.readLines(SpoolingFileLineReader.java:180)
 at
org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:135)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
 at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
 at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
 at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

It usually happened when dropping some new files into the spooling dir, and
stop collecting file. Does someone know the reason and how to avoid it?

Thanks very much!
--
Best Regards,
Henry Ma
+
Brock Noland 2013-01-18, 04:39
+
Henry Ma 2013-01-18, 05:22
+
Brock Noland 2013-01-18, 05:31
+
Patrick Wendell 2013-01-18, 05:48
+
Henry Ma 2013-01-18, 05:59
+
Mike Percy 2013-01-18, 06:05
+
Henry Ma 2013-01-18, 06:23
+
Mike Percy 2013-01-18, 07:45
+
Henry Ma 2013-01-18, 08:05
+
Henry Ma 2013-01-18, 08:18
+
Connor Woodson 2013-01-18, 09:13
+
Mike Percy 2013-01-18, 09:26
+
Henry Ma 2013-01-18, 09:32