Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> flume master down, flume node still has multiple orphan processes


+
Shengjie Min 2012-12-19, 11:34
+
Nitin Pawar 2012-12-19, 11:54
Copy link to this message
-
Re: flume master down, flume node still has multiple orphan processes
I'd love to move to 1.3.0, but unfortunately, this is the case on our
stage, we will need to live with it for a while.

Shengjie
On 19 December 2012 11:54, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> first request : Please move to flume-1.3.0
>
>
>
>
>
> On Wed, Dec 19, 2012 at 5:04 PM, Shengjie Min <[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> I noticed that when my flume master is down for a quite while. My flume
>> agent is retrying to connect to the master, i can tell that from the flume
>> logs as below;
>>
>> 2012-12-19 11:11:42,126 WARN com.cloudera.flume.agent.MultiMasterRPC:
>> Could not connect to any master nodes (tried 1: [flume-master-01:35872])
>> 2012-12-19 11:11:52,140 WARN com.cloudera.flume.agent.MultiMasterRPC:
>> Could not connect to any master nodes (tried 1: [flume-master-01:35872])
>> 2012-12-19 11:12:02,152 WARN com.cloudera.flume.agent.MultiMasterRPC:
>> Could not connect to any master nodes (tried 1: [flume-master-01:35872])
>> 2012-12-19 11:12:12,162 WARN com.cloudera.flume.agent.MultiMasterRPC:
>> Could not connect to any master nodes (tried 1: [flume-master-01:35872])
>>
>> from "top", I've seen a lot of java processes owned by flume. followed my
>> instinct, I stopped flume agent, after a while, I run "top" on it, I still
>> have a lot of processes owned by flume user.
>>
>> 12735 flume     20   0 1487m  26m  128 S  0.3  1.3   0:05.41 java
>>
>>
>>
>>
>> 13828 flume     20   0 1487m   24   24 S  0.3  0.0   8:11.92 java
>>
>>
>>
>>
>> 14442 flume     20   0 1487m    0    0 S  0.3  0.0   8:06.81 java
>>
>>
>>
>>
>> 15033 flume     20   0 1487m  26m  164 S  0.3  1.3   0:04.29 java
>>
>>
>>
>>
>> 15453 flume     20   0 1487m    4    4 S  0.3  0.0   8:07.55 java
>>
>>
>>
>>
>> 15964 flume     20   0 1487m  27m  164 S  0.3  1.4   0:04.09 java
>>
>>
>>
>>
>> 16098 flume     20   0 1487m    0    0 S  0.3  0.0   8:12.67 java
>> ......................
>>
>> Why so many processes are generated here and they don't go away even when
>> flume is stopped.
>>
>> --
>> All the best,
>> Shengjie Min
>>
>>
>
>
> --
> Nitin Pawar
>
>
--
All the best,
Shengjie Min
+
Alexander Alten-Lorenz 2012-12-19, 12:20