Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Unable to use HDFS sink


+
Lichen 2012-09-29, 07:57
+
Brock Noland 2012-09-29, 14:18
+
Mike Percy 2012-09-30, 02:49
+
Lichen 2012-10-08, 07:37
+
Mike Percy 2012-10-09, 02:58
+
Lichen 2012-10-09, 03:48
Copy link to this message
-
Re: Unable to use HDFS sink
Hi Chen,
I don't see the SinkRunner thread so it didn't get very far. I'm not sure
what went wrong but it looks like some error was swallowed somewhere by
some Thread maybe. Seems strange. But it isn't immediately obvious to me
what went wrong since if you are using a recent version of Flume it should
print an error to the log if it gets a ClassNotFoundException, say if it
can't find the Hadoop classes.

Regards,
Mike
On Mon, Oct 8, 2012 a

t 8:48 PM, Lichen <[EMAIL PROTECTED]> wrote:

>  Mike, I’ve dumped flume and get this:****
>
> ** **
>
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode):*
> ***
>
> ** **
>
> "Attach Listener" daemon prio=10 tid=0x00002aaab5088000 nid=0x3229 waiting
> on condition [0x0000000000000000]****
>
>    java.lang.Thread.State: RUNNABLE****
>
> ** **
>
>    Locked ownable synchronizers:****
>
>         - None****
>
> ** **
>
> "conf-file-poller-0" prio=10 tid=0x00002aaab50d6000 nid=0x3210 waiting on
> condition [0x0000000041139000]****
>
>    java.lang.Thread.State: WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>         - parking to wait for  <0x00002aaab49f8aa8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
>         at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)****
>
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
> ****
>
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)****
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
>         at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
>    Locked ownable synchronizers:****
>
>         - None****
>
> ** **
>
> "lifecycleSupervisor-1-0" prio=10 tid=0x00002aaab50fe000 nid=0x320f
> waiting on condition [0x0000000041038000]****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>         - parking to wait for  <0x00002aaab49ff488> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
> ****
>
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)****
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
>         at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
>    Locked ownable synchronizers:****
>
>         - None****
>
> ** **
>
> "lifecycleSupervisor-1-2" prio=10 tid=0x00002aaab5cf7800 nid=0x320e
> waiting on condition [0x0000000040f37000]****
>
>    java.lang.Thread.State: TIMED_WAITING (parking)****
>
>         at sun.misc.Unsafe.park(Native Method)****
>
>         - parking to wait for  <0x00002aaab4a23be8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
+
Hari Shreedharan 2012-09-30, 03:38
+
Yanzhi.liu 2012-09-29, 08:13
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB