Flume, mail # user - How to run flume-mg in background?

How to run flume-mg in background?

GuoWei 2013-01-22, 06:38

Dear all,

Can you tell me how to start flume-mg agent in background mode ?

Thanks a lot.

Best Regards / 商祺
郭伟 Guo Wei
-----------------------------------------------------
南京西桥科技有限公司
Western Bridge Tech Ltd., Nanjing

南京市玄武区花园路8号一号楼511
No. 511, Building 1, No. 8, Hua Yuan Road

Xuanwu District, Nanjing, PR China

Email: [EMAIL PROTECTED]

Tel: +86 25 8528 4900 (Operator)
Mobile: +86 138 1589 8257
Fax: +86 25 8528 4980

Weibo: http://weibo.com/guowee
Web: http://www.wbkit.com
-----------------------------------------------------
WesternBridge Tech: Professional software service provider. Professional is MANNER as well CAPABILITY.

Re: How to run flume-mg in background?

Connor Woodson 2013-01-22, 08:32

Easiest way I have found is to run it in a screen instance:

$ screen -R <unique name>
(you're now in a screen instance)
$ <run flume>
(type Ctrl-a then d to leave screen; to go back to that instance, retype
the command from above)

- Connor
On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]> wrote:

> Dear all,
>
> Can you tell me how to start flume-mg agent in background mode ?
>
> Thanks a lot.
>
>
>
> Best Regards / 商祺
> 郭伟 Guo Wei
> -----------------------------------------------------
> 南京西桥科技有限公司
> Western Bridge Tech Ltd., Nanjing
>
> 南京市玄武区花园路8号一号楼511
> No. 511, Building 1, No. 8, Hua Yuan Road
>
> Xuanwu District, Nanjing, PR China
>
> Email: [EMAIL PROTECTED]
>
> Tel: +86 25 8528 4900 (Operator)
> Mobile: +86 138 1589 8257
> Fax: +86 25 8528 4980
>
> Weibo: http://weibo.com/guowee
> Web: http://www.wbkit.com
> -----------------------------------------------------
> WesternBridge Tech: Professional software service provider. Professional
> is MANNER as well CAPABILITY.
>
>

Re: How to run flume-mg in background?

Nitin Pawar 2013-01-22, 08:34

also try ending the command with &
On Tue, Jan 22, 2013 at 2:02 PM, Connor Woodson <[EMAIL PROTECTED]>wrote:

> Easiest way I have found is to run it in a screen instance:
>
> $ screen -R <unique name>
> (you're now in a screen instance)
> $ <run flume>
> (type Ctrl-a then d to leave screen; to go back to that instance, retype
> the command from above)
>
> - Connor
>
>
> On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]> wrote:
>
>> Dear all,
>>
>> Can you tell me how to start flume-mg agent in background mode ?
>>
>> Thanks a lot.
>>
>>
>>
>> Best Regards / 商祺
>> 郭伟 Guo Wei
>> -----------------------------------------------------
>> 南京西桥科技有限公司
>> Western Bridge Tech Ltd., Nanjing
>>
>> 南京市玄武区花园路8号一号楼511
>> No. 511, Building 1, No. 8, Hua Yuan Road
>>
>> Xuanwu District, Nanjing, PR China
>>
>> Email: [EMAIL PROTECTED]
>>
>> Tel: +86 25 8528 4900 (Operator)
>> Mobile: +86 138 1589 8257
>> Fax: +86 25 8528 4980
>>
>> Weibo: http://weibo.com/guowee
>> Web: http://www.wbkit.com
>> -----------------------------------------------------
>> WesternBridge Tech: Professional software service provider. Professional
>> is MANNER as well CAPABILITY.
>>
>>
>
--
Nitin Pawar

Re: How to run flume-mg in background?

GuoWei 2013-01-22, 08:48

Thanks a lot

I try to use nohup at the beginning of the flume-mg. It seems also works.

Do you try that ?

Thanks

On 2013-1-22, at 下午4:34, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> also try ending the command with &
>
>
> On Tue, Jan 22, 2013 at 2:02 PM, Connor Woodson <[EMAIL PROTECTED]> wrote:
> Easiest way I have found is to run it in a screen instance:
>
> $ screen -R <unique name>
> (you're now in a screen instance)
> $ <run flume>
> (type Ctrl-a then d to leave screen; to go back to that instance, retype the command from above)
>
> - Connor
>
>
> On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]> wrote:
> Dear all,
>
> Can you tell me how to start flume-mg agent in background mode ?
>
> Thanks a lot.
>
>
>
> Best Regards / 商祺
> 郭伟 Guo Wei
> -----------------------------------------------------
> 南京西桥科技有限公司
> Western Bridge Tech Ltd., Nanjing
>
> 南京市玄武区花园路8号一号楼511
> No. 511, Building 1, No. 8, Hua Yuan Road
>
> Xuanwu District, Nanjing, PR China
>
> Email: [EMAIL PROTECTED]
>
> Tel: +86 25 8528 4900 (Operator)
> Mobile: +86 138 1589 8257
> Fax: +86 25 8528 4980
>
> Weibo: http://weibo.com/guowee
> Web: http://www.wbkit.com
> -----------------------------------------------------
> WesternBridge Tech: Professional software service provider. Professional is MANNER as well CAPABILITY.
>
>
>
>
>
> --
> Nitin Pawar

Re: How to run flume-mg in background?

Juhani Connolly 2013-01-22, 08:59

We use "nohup <command> &" and record the process id after.

I'm pretty sure the cdh distribution of flume does the same, so you
might want to have a look at that if you want a ready made init.d file
and whatnot

On 01/22/2013 05:48 PM, GuoWei wrote:
> Thanks a lot
>
> I try to use nohup at the beginning of the flume-mg. It seems also works.
>
> Do you try that ?
>
> Thanks
>
> On 2013-1-22, at 锟斤拷锟斤拷4:34, Nitin Pawar <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>> wrote:
>
>> also try ending the command with &
>>
>>
>> On Tue, Jan 22, 2013 at 2:02 PM, Connor Woodson
>> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Easiest way I have found is to run it in a screen instance:
>>
>> $ screen -R <unique name>
>> (you're now in a screen instance)
>> $ <run flume>
>> (type Ctrl-a then d to leave screen; to go back to that instance,
>> retype the command from above)
>>
>> - Connor
>>
>>
>> On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]
>> <mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Dear all,
>>
>> Can you tell me how to start flume-mg agent in background mode ?
>>
>> Thanks a lot.
>>
>>
>>
>> Best Regards / 锟斤拷锟斤拷
>> 锟斤拷伟Guo Wei
>> -----------------------------------------------------
>> 锟较撅拷锟斤拷锟脚科硷拷锟斤拷锟睫癸拷司
>> Western Bridge Tech Ltd.,Nanjing
>>
>> 锟较撅拷锟斤拷锟斤拷锟斤拷锟斤拷园路8锟斤拷一锟斤拷楼511
>> No. 511, Building 1, No. 8,Hua Yuan Road
>>
>> Xuanwu District, Nanjing, PRChina
>>
>> Email: [EMAIL PROTECTED] <http://wbkit.com/>
>>
>> Tel: +86 25 8528 4900 <tel:%2B86%2025%208528%204900>(Operator)
>> Mobile: +86 138 1589 8257 <tel:%2B86%20138%C2%A01589%C2%A08257>
>> Fax: +86 25 8528 4980 <tel:%2B86%2025%208528%204980>
>>
>> Weibo: http://weibo.com/guowee
>> Web: http://www.wbkit.com <http://www.wbkit.com/>
>> -----------------------------------------------------
>> WesternBridge Tech: Professional software service provider.
>> Professional is MANNER as well CAPABILITY.
>>
>>
>>
>>
>>
>> --
>> Nitin Pawar
>

Re: How to run flume-mg in background?

Nitin Pawar 2013-01-22, 08:59

yes that works as well
On Tue, Jan 22, 2013 at 2:18 PM, GuoWei <[EMAIL PROTECTED]> wrote:

> Thanks a lot
>
> I try to use nohup at the beginning of the flume-mg. It seems also works.
>
> Do you try that ?
>
> Thanks
>
> On 2013-1-22, at 下午4:34, Nitin Pawar <[EMAIL PROTECTED]> wrote:
>
> also try ending the command with &
>
>
> On Tue, Jan 22, 2013 at 2:02 PM, Connor Woodson <[EMAIL PROTECTED]>wrote:
>
>> Easiest way I have found is to run it in a screen instance:
>>
>> $ screen -R <unique name>
>> (you're now in a screen instance)
>> $ <run flume>
>> (type Ctrl-a then d to leave screen; to go back to that instance, retype
>> the command from above)
>>
>> - Connor
>>
>>
>> On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]> wrote:
>>
>>> Dear all,
>>>
>>> Can you tell me how to start flume-mg agent in background mode ?
>>>
>>> Thanks a lot.
>>>
>>>
>>>
>>> Best Regards / 商祺
>>> 郭伟 Guo Wei
>>> -----------------------------------------------------
>>> 南京西桥科技有限公司
>>> Western Bridge Tech Ltd., Nanjing
>>>
>>> 南京市玄武区花园路8号一号楼511
>>> No. 511, Building 1, No. 8, Hua Yuan Road
>>>
>>> Xuanwu District, Nanjing, PR China
>>>
>>> Email: [EMAIL PROTECTED]
>>>
>>> Tel: +86 25 8528 4900 (Operator)
>>> Mobile: +86 138 1589 8257
>>> Fax: +86 25 8528 4980
>>>
>>> Weibo: http://weibo.com/guowee
>>> Web: http://www.wbkit.com
>>> -----------------------------------------------------
>>> WesternBridge Tech: Professional software service provider. Professional
>>> is MANNER as well CAPABILITY.
>>>
>>>
>>
>
>
> --
> Nitin Pawar
>
>
>
--
Nitin Pawar

Re: How to run flume-mg in background?

shekhar sharma 2013-01-22, 16:54

nohup ./flume-ng agent --conf ../conf -f ../conf/host1.properties -n host1 &

On Tue, Jan 22, 2013 at 12:08 PM, GuoWei <[EMAIL PROTECTED]> wrote:

> Dear all,
>
> Can you tell me how to start flume-mg agent in background mode ?
>
> Thanks a lot.
>
>
>
> Best Regards / 商祺
> 郭伟 Guo Wei
> -----------------------------------------------------
> 南京西桥科技有限公司
> Western Bridge Tech Ltd., Nanjing
>
> 南京市玄武区花园路8号一号楼511
> No. 511, Building 1, No. 8, Hua Yuan Road
>
> Xuanwu District, Nanjing, PR China
>
> Email: [EMAIL PROTECTED]
>
> Tel: +86 25 8528 4900 (Operator)
> Mobile: +86 138 1589 8257
> Fax: +86 25 8528 4980
>
> Weibo: http://weibo.com/guowee
> Web: http://www.wbkit.com
> -----------------------------------------------------
> WesternBridge Tech: Professional software service provider. Professional
> is MANNER as well CAPABILITY.
>
>

Re: How to run flume-mg in background?

Andrew Otto 2013-01-22, 17:00

This is the flume-ng-agent init.d script included with CDH4. Drop it in /etc/init.d/flume-ng-agent, make it executable (chmod 755 /etc/init.d/flume-ng-agent), and then you can start/stop flume to your heart's content.

https://gist.github.com/4596260

On Jan 22, 2013, at 3:59 AM, Juhani Connolly <[EMAIL PROTECTED]> wrote:

> We use "nohup <command> &" and record the process id after.
>
> I'm pretty sure the cdh distribution of flume does the same, so you might want to have a look at that if you want a ready made init.d file and whatnot
>
> On 01/22/2013 05:48 PM, GuoWei wrote:
>> Thanks a lot
>>
>> I try to use nohup at the beginning of the flume-mg. It seems also works.
>>
>> Do you try that ?
>>
>> Thanks
>>
>> On 2013-1-22, at 下午4:34, Nitin Pawar <[EMAIL PROTECTED]> wrote:
>>
>>> also try ending the command with &
>>>
>>>
>>> On Tue, Jan 22, 2013 at 2:02 PM, Connor Woodson <[EMAIL PROTECTED]> wrote:
>>> Easiest way I have found is to run it in a screen instance:
>>>
>>> $ screen -R <unique name>
>>> (you're now in a screen instance)
>>> $ <run flume>
>>> (type Ctrl-a then d to leave screen; to go back to that instance, retype the command from above)
>>>
>>> - Connor
>>>
>>>
>>> On Mon, Jan 21, 2013 at 10:38 PM, GuoWei <[EMAIL PROTECTED]> wrote:
>>> Dear all,
>>>
>>> Can you tell me how to start flume-mg agent in background mode ?
>>>
>>> Thanks a lot.
>>>
>>>
>>>
>>> Best Regards / 商祺
>>> 郭伟 Guo Wei
>>> -----------------------------------------------------
>>> 南京西桥科技有限公司
>>> Western Bridge Tech Ltd., Nanjing
>>>
>>> 南京市玄武区花园路8号一号楼511
>>> No. 511, Building 1, No. 8, Hua Yuan Road
>>>
>>> Xuanwu District, Nanjing, PR China
>>>
>>> Email: [EMAIL PROTECTED]
>>>
>>> Tel: +86 25 8528 4900 (Operator)
>>> Mobile: +86 138 1589 8257
>>> Fax: +86 25 8528 4980
>>>
>>> Weibo: http://weibo.com/guowee
>>> Web: http://www.wbkit.com
>>> -----------------------------------------------------
>>> WesternBridge Tech: Professional software service provider. Professional is MANNER as well CAPABILITY.
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>
>