|
shouvanik.haldar@...
2012-12-10, 06:10
Nitin Pawar
2012-12-10, 07:22
shouvanik.haldar@...
2012-12-10, 08:17
Nitin Pawar
2012-12-10, 09:13
shouvanik.haldar@...
2012-12-10, 09:31
Nitin Pawar
2012-12-10, 10:03
shouvanik.haldar@...
2012-12-11, 07:14
Nitin Pawar
2012-12-11, 07:24
shouvanik.haldar@...
2012-12-11, 07:27
Alexander Alten-Lorenz
2012-12-11, 07:33
shouvanik.haldar@...
2012-12-11, 08:11
Brock Noland
2012-12-10, 12:42
shouvanik.haldar@...
2012-12-10, 06:04
shouvanik.haldar@...
2012-12-11, 12:45
Alexander Alten-Lorenz
2012-12-11, 13:40
shouvanik.haldar@...
2012-12-11, 13:48
shouvanik.haldar@...
2012-12-11, 12:43
shouvanik.haldar@...
2012-12-11, 08:35
|
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-10, 06:10
Before the below mentioned error, I get a success message like
2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Haldar, Shouvanik Sent: Monday, December 10, 2012 11:34 AM To: '[EMAIL PROTECTED]' Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I had configured flume-master as well as flume-node on a single machine. Now, as I run terracotta -> L1 cache, I get the INFO below in / 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Can you please help? I am struggling with this for the past 1 day without success! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise private information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com +
shouvanik.haldar@... 2012-12-10, 06:10
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Nitin Pawar 2012-12-10, 07:22
what version of flume are you using? If it is < 1.x then recommend you to
upgrade to latest 1.0.3 If you are on 1.x then can you tell us whats the hostname for your server? On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]> wrote: > Before the below mentioned error, I get a success message like**** > > ** ** > > 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: > Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] > [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory > **** > > ** ** > > *Thanks and Regards,* > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 * > > ** ** > > *From:* Haldar, Shouvanik > *Sent:* Monday, December 10, 2012 11:34 AM > *To:* '[EMAIL PROTECTED]' > *Subject:* Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > ** ** > > I had configured flume-master as well as flume-node on a single machine. * > *** > > Now, as I run terracotta -> L1 cache, I get the INFO below in /**** > > ** ** > > 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: > Subprocess exited with value 1**** > > ** ** > > Can you please help? I am struggling with this for the past 1 day without > success!**** > > ** ** > > *Thanks and Regards,* > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 * > > ** ** > > ------------------------------ > This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise private information. If you have > received it in error, please notify the sender immediately and delete the > original. Any other use of the e-mail by you is prohibited. > > Where allowed by local law, electronic communications with Accenture and > its affiliates, including e-mail and instant messaging (including content), > may be scanned by our systems for the purposes of information security and > assessment of internal compliance with Accenture policy. > > > ______________________________________________________________________________________ > > www.accenture.com > -- Nitin Pawar +
Nitin Pawar 2012-12-10, 07:22
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-10, 08:17
Hi,
I am using Flume -> Flume 0.9.4-cdh3u5. Initially, the logs are ok. But when I start terracotta (./start-tc-server.sh) , then only I experience the above phenomena! Is it something to do with terracotta.! 2012-12-10 03:14:08,806 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853... 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Before starting terracotta, Flume Node status is "OPENING". But when I start terracotta, I got the error "INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1" Please help ! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Monday, December 10, 2012 12:52 PM To: [EMAIL PROTECTED] Cc: Haldar, Shouvanik Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 what version of flume are you using? If it is < 1.x then recommend you to upgrade to latest 1.0.3 If you are on 1.x then can you tell us whats the hostname for your server? On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Before the below mentioned error, I get a success message like 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Haldar, Shouvanik Sent: Monday, December 10, 2012 11:34 AM To: '[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>' Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I had configured flume-master as well as flume-node on a single machine. Now, as I run terracotta -> L1 cache, I get the INFO below in / 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Can you please help? I am struggling with this for the past 1 day without success! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise private information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com<http://www.accenture.com> -- Nitin Pawar +
shouvanik.haldar@... 2012-12-10, 08:17
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Nitin Pawar 2012-12-10, 09:13
I just hope you are not hitting this
https://issues.apache.org/jira/browse/FLUME-796 I would also like to recommend you to upgraded to flume 1.x asap if possible can you try changing your flume source to some random file with tail -f and try sinking it to some file. That will narrow the problem is on flume side or terracotta side Thanks, Nitin On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]> wrote: > Hi,**** > > ** ** > > I am using Flume -> Flume 0.9.4-cdh3u5. **** > > ** ** > > Initially, the logs are ok. But when I start terracotta > (./start-tc-server.sh) , then only I experience the above phenomena! Is it > something to do with terracotta.!**** > > ** ** > > ** ** > > 2012-12-10 03:14:08,806 INFO > com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking > thread pool server on port 35853...**** > > 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: > Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] > [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory > **** > > ** ** > > Before starting terracotta, Flume Node status is “OPENING”.**** > > But when I start terracotta, I got the error “INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1”**** > > ** ** > > Please help !**** > > ** ** > > ** ** > > *Thanks and Regards,* > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 * > > ** ** > > *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Monday, December 10, 2012 12:52 PM > *To:* [EMAIL PROTECTED] > *Cc:* Haldar, Shouvanik > *Subject:* Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > ** ** > > what version of flume are you using? If it is < 1.x then recommend you to > upgrade to latest 1.0.3 **** > > If you are on 1.x then can you tell us whats the hostname for your server? > **** > > ** ** > > On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]> wrote:* > *** > > Before the below mentioned error, I get a success message like**** > > **** > > 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: > Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] > [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory > **** > > **** > > *Thanks and Regards,***** > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ***** > > **** > > *From:* Haldar, Shouvanik > *Sent:* Monday, December 10, 2012 11:34 AM > *To:* '[EMAIL PROTECTED]' > *Subject:* Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > **** > > I had configured flume-master as well as flume-node on a single machine. * > *** > > Now, as I run terracotta -> L1 cache, I get the INFO below in /**** > > **** > > 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: > Subprocess exited with value 1**** > > **** > > Can you please help? I am struggling with this for the past 1 day without > success!**** > > **** > > *Thanks and Regards,***** > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ***** > > **** > > ** ** > ------------------------------ > > This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise private information. If you have > received it in error, please notify the sender immediately and delete the > original. Any other use of the e-mail by you is prohibited. > > Where allowed by local law, electronic communications with Accenture and > its affiliates, including e-mail and instant messaging (including content), > may be scanned by our systems for the purposes of information security and > assessment of internal compliance with Accenture policy. > > > ______________________________________________________________________________________ > > www.accenture.com**** > > > > **** > > ** ** > > -- > Nitin Pawar**** Nitin Pawar +
Nitin Pawar 2012-12-10, 09:13
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-10, 09:31
Hello,
I am sure, the problem is due to Terracotta. Can you please help me? Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Monday, December 10, 2012 2:43 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I just hope you are not hitting this https://issues.apache.org/jira/browse/FLUME-796 I would also like to recommend you to upgraded to flume 1.x asap if possible can you try changing your flume source to some random file with tail -f and try sinking it to some file. That will narrow the problem is on flume side or terracotta side Thanks, Nitin On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hi, I am using Flume -> Flume 0.9.4-cdh3u5. Initially, the logs are ok. But when I start terracotta (./start-tc-server.sh) , then only I experience the above phenomena! Is it something to do with terracotta.! 2012-12-10 03:14:08,806 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853... 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Before starting terracotta, Flume Node status is "OPENING". But when I start terracotta, I got the error "INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1" Please help ! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 12:52 PM To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Cc: Haldar, Shouvanik Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 what version of flume are you using? If it is < 1.x then recommend you to upgrade to latest 1.0.3 If you are on 1.x then can you tell us whats the hostname for your server? On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Before the below mentioned error, I get a success message like 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Haldar, Shouvanik Sent: Monday, December 10, 2012 11:34 AM To: '[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>' Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I had configured flume-master as well as flume-node on a single machine. Now, as I run terracotta -> L1 cache, I get the INFO below in / 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Can you please help? I am struggling with this for the past 1 day without success! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise private information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com<http://www.accenture.com> Nitin Pawar Nitin Pawar +
shouvanik.haldar@... 2012-12-10, 09:31
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Nitin Pawar 2012-12-10, 10:03
just a random question, does the user running flume agent have permission
to read the event details out of terracotta ? from the code here http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java line 209 onwards, it looks like the error condition is achieved when you have channel set as stdin (I am not sure about this so you may need to look at code which part of code you are hitting depending on the flume configs you have) On Mon, Dec 10, 2012 at 3:01 PM, <[EMAIL PROTECTED]> wrote: > Hello,**** > > ** ** > > I am sure, the problem is due to Terracotta. Can you please help me? **** > > ** ** > > *Thanks and Regards,* > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 * > > ** ** > > *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Monday, December 10, 2012 2:43 PM > *To:* Haldar, Shouvanik > *Cc:* [EMAIL PROTECTED] > > *Subject:* Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > ** ** > > I just hope you are not hitting this > https://issues.apache.org/jira/browse/FLUME-796**** > > I would also like to recommend you to upgraded to flume 1.x asap **** > > ** ** > > if possible can you try changing your flume source to some random file > with tail -f and try sinking it to some file. That will narrow the problem > is on flume side or terracotta side **** > > ** ** > > Thanks,**** > > Nitin **** > > ** ** > > On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]> wrote:** > ** > > Hi,**** > > **** > > I am using Flume -> Flume 0.9.4-cdh3u5. **** > > **** > > Initially, the logs are ok. But when I start terracotta > (./start-tc-server.sh) , then only I experience the above phenomena! Is it > something to do with terracotta.!**** > > **** > > **** > > 2012-12-10 03:14:08,806 INFO > com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking > thread pool server on port 35853...**** > > 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: > Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] > [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory > **** > > **** > > Before starting terracotta, Flume Node status is “OPENING”.**** > > But when I start terracotta, I got the error “INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1”**** > > **** > > Please help !**** > > **** > > **** > > *Thanks and Regards,***** > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ***** > > **** > > *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Monday, December 10, 2012 12:52 PM > *To:* [EMAIL PROTECTED] > *Cc:* Haldar, Shouvanik > *Subject:* Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > **** > > what version of flume are you using? If it is < 1.x then recommend you to > upgrade to latest 1.0.3 **** > > If you are on 1.x then can you tell us whats the hostname for your server? > **** > > **** > > On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]> wrote:* > *** > > Before the below mentioned error, I get a success message like**** > > **** > > 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: > Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] > [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory > **** > > **** > > *Thanks and Regards,***** > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ***** > > **** > > *From:* Haldar, Shouvanik > *Sent:* Monday, December 10, 2012 11:34 AM > *To:* '[EMAIL PROTECTED]' > *Subject:* Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > **** > > I had configured flume-master as well as flume-node on a single machine. * Nitin Pawar +
Nitin Pawar 2012-12-10, 10:03
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 07:14
Hi,
I installed flume 1.x higher version today! But is this very much different from the earlier. ? Is there no master / node concept here? How do I configure the source and sink? Think I got screwed here! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Monday, December 10, 2012 3:34 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 just a random question, does the user running flume agent have permission to read the event details out of terracotta ? from the code here http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java line 209 onwards, it looks like the error condition is achieved when you have channel set as stdin (I am not sure about this so you may need to look at code which part of code you are hitting depending on the flume configs you have) On Mon, Dec 10, 2012 at 3:01 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hello, I am sure, the problem is due to Terracotta. Can you please help me? Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 2:43 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I just hope you are not hitting this https://issues.apache.org/jira/browse/FLUME-796 I would also like to recommend you to upgraded to flume 1.x asap if possible can you try changing your flume source to some random file with tail -f and try sinking it to some file. That will narrow the problem is on flume side or terracotta side Thanks, Nitin On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hi, I am using Flume -> Flume 0.9.4-cdh3u5. Initially, the logs are ok. But when I start terracotta (./start-tc-server.sh) , then only I experience the above phenomena! Is it something to do with terracotta.! 2012-12-10 03:14:08,806 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853... 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Before starting terracotta, Flume Node status is "OPENING". But when I start terracotta, I got the error "INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1" Please help ! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 12:52 PM To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Cc: Haldar, Shouvanik Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 what version of flume are you using? If it is < 1.x then recommend you to upgrade to latest 1.0.3 If you are on 1.x then can you tell us whats the hostname for your server? On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Before the below mentioned error, I get a success message like 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Haldar, Shouvanik Sent: Monday, December 10, 2012 11:34 AM To: '[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>' Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I had configured flume-master as well as flume-node on a single machine. Now, as I run terracotta -> L1 cache, I get the INFO below in / 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Can you please help? I am struggling with this for the past 1 day without success! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise private information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com<http://www.accenture.com> Nitin Pawar Nitin Pawar Nitin Pawar +
shouvanik.haldar@... 2012-12-11, 07:14
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Nitin Pawar 2012-12-11, 07:24
there is no master/slave architecture now
its a simple conf file like below <@EOM> and then just start the agent. it will do needful you need to start flume like the command below bin/flume-ng agent --conf-file example.conf --name agent1 agent1.sources = tail agent1.channels = MemoryChannel-2 agent1.sinks = HDFS agent1.sources.tail.type = exec agent1.sources.tail.command = tail -F <file> agent1.sources.tail.channels = MemoryChannel-2 agent1.sources.tail.interceptors = hostint agent1.sources.tail.interceptors.hostint.type org.apache.flume.interceptor.HostInterceptor$Builder agent1.sources.tail.interceptors.hostint.preserveExisting = true agent1.sources.tail.interceptors.hostint.useIP = true agent1.sinks.HDFS.channel = MemoryChannel-2 agent1.sinks.HDFS.type = hdfs agent1.sinks.HDFS.hdfs.path = hdfs://url:8020/user/flume/%{host} agent1.sinks.HDFS.hdfs.file.Type = SequenceFile agent1.sinks.HDFS.hdfs.writeFormat = Text agent1.sinks.HDFS.hdfs.rollInterval = 30 agent1.sinks.HDFS.hdfs.rollCount = 0 agent1.sinks.HDFS.hdfs.rollSize = 5000000000 agent1.channels.MemoryChannel-2.type = memory more examples at http://flume.apache.org/FlumeUserGuide.html On Tue, Dec 11, 2012 at 12:44 PM, <[EMAIL PROTECTED]> wrote: > Hi,**** > > I installed flume 1.x higher version today! But is this very much > different from the earlier. ? Is there no master / node concept here? How > do I configure the source and sink?**** > > ** ** > > Think I got screwed here!**** > > ** ** > > *Thanks and Regards,* > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 * > > ** ** > > *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Monday, December 10, 2012 3:34 PM > > *To:* Haldar, Shouvanik > *Cc:* [EMAIL PROTECTED] > *Subject:* Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > ** ** > > just a random question, does the user running flume agent have permission > to read the event details out of terracotta ? **** > > ** ** > > from the code here > http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java > **** > > ** ** > > line 209 onwards, it looks like the error condition is achieved when you > have channel set as stdin (I am not sure about this so you may need to look > at code which part of code you are hitting depending on the flume configs > you have) **** > > ** ** > > ** ** > > ** ** > > On Mon, Dec 10, 2012 at 3:01 PM, <[EMAIL PROTECTED]> wrote:** > ** > > Hello,**** > > **** > > I am sure, the problem is due to Terracotta. Can you please help me? **** > > **** > > *Thanks and Regards,***** > > *Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ***** > > **** > > *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] > *Sent:* Monday, December 10, 2012 2:43 PM > *To:* Haldar, Shouvanik > *Cc:* [EMAIL PROTECTED]**** > > > *Subject:* Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO > com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1**** > > **** > > I just hope you are not hitting this > https://issues.apache.org/jira/browse/FLUME-796**** > > I would also like to recommend you to upgraded to flume 1.x asap **** > > **** > > if possible can you try changing your flume source to some random file > with tail -f and try sinking it to some file. That will narrow the problem > is on flume side or terracotta side **** > > **** > > Thanks,**** > > Nitin **** > > **** > > On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]> wrote:** > ** > > Hi,**** > > **** > > I am using Flume -> Flume 0.9.4-cdh3u5. **** > > **** > > Initially, the logs are ok. But when I start terracotta > (./start-tc-server.sh) , then only I experience the above phenomena! Is it > something to do with terracotta.!**** > > **** > > **** > > 2012-12-10 03:14:08,806 INFO > com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking Nitin Pawar +
Nitin Pawar 2012-12-11, 07:24
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 07:27
Hi,
Can you please help me on one thing! Mistakenly deleted /etc/init.d/flume-master script. Now flume-master is not getting uninstalled or removed! Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 11, 2012 12:55 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 there is no master/slave architecture now its a simple conf file like below <@EOM> and then just start the agent. it will do needful you need to start flume like the command below bin/flume-ng agent --conf-file example.conf --name agent1 agent1.sources = tail agent1.channels = MemoryChannel-2 agent1.sinks = HDFS agent1.sources.tail.type = exec agent1.sources.tail.command = tail -F <file> agent1.sources.tail.channels = MemoryChannel-2 agent1.sources.tail.interceptors = hostint agent1.sources.tail.interceptors.hostint.type = org.apache.flume.interceptor.HostInterceptor$Builder agent1.sources.tail.interceptors.hostint.preserveExisting = true agent1.sources.tail.interceptors.hostint.useIP = true agent1.sinks.HDFS.channel = MemoryChannel-2 agent1.sinks.HDFS.type = hdfs agent1.sinks.HDFS.hdfs.path = hdfs://url:8020/user/flume/%{host} agent1.sinks.HDFS.hdfs.file.Type = SequenceFile agent1.sinks.HDFS.hdfs.writeFormat = Text agent1.sinks.HDFS.hdfs.rollInterval = 30 agent1.sinks.HDFS.hdfs.rollCount = 0 agent1.sinks.HDFS.hdfs.rollSize = 5000000000 agent1.channels.MemoryChannel-2.type = memory more examples at http://flume.apache.org/FlumeUserGuide.html On Tue, Dec 11, 2012 at 12:44 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hi, I installed flume 1.x higher version today! But is this very much different from the earlier. ? Is there no master / node concept here? How do I configure the source and sink? Think I got screwed here! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 3:34 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 just a random question, does the user running flume agent have permission to read the event details out of terracotta ? from the code here http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java line 209 onwards, it looks like the error condition is achieved when you have channel set as stdin (I am not sure about this so you may need to look at code which part of code you are hitting depending on the flume configs you have) On Mon, Dec 10, 2012 at 3:01 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hello, I am sure, the problem is due to Terracotta. Can you please help me? Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 2:43 PM To: Haldar, Shouvanik Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 I just hope you are not hitting this https://issues.apache.org/jira/browse/FLUME-796 I would also like to recommend you to upgraded to flume 1.x asap if possible can you try changing your flume source to some random file with tail -f and try sinking it to some file. That will narrow the problem is on flume side or terracotta side Thanks, Nitin On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Hi, I am using Flume -> Flume 0.9.4-cdh3u5. Initially, the logs are ok. But when I start terracotta (./start-tc-server.sh) , then only I experience the above phenomena! Is it something to do with terracotta.! 2012-12-10 03:14:08,806 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853... 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Before starting terracotta, Flume Node status is "OPENING". But when I start terracotta, I got the error "INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1" Please help ! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] Sent: Monday, December 10, 2012 12:52 PM To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> Cc: Haldar, Shouvanik Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 what version of flume are you using? If it is < 1.x then recommend you to upgrade to latest 1.0.3 If you are on 1.x then can you tell us whats the hostname for your server? On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: Before the below mentioned error, I get a success message like 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> From: Haldar, Shouvanik Sent: Monday, December 10, 2012 1 +
shouvanik.haldar@... 2012-12-11, 07:27
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Alexander Alten-Lorenz 2012-12-11, 07:33
Hi,
yum remove --force <paketname> Or simply create a empty file called /etc/init.d/flume-master: echo "foo" > /etc/init.d/flume-master best - Alex On Dec 11, 2012, at 8:27 AM, [EMAIL PROTECTED] wrote: > Hi, > > Can you please help me on one thing! Mistakenly deleted /etc/init.d/flume-master script. Now flume-master is not getting uninstalled or removed! Please help! > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > From: Nitin Pawar [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, December 11, 2012 12:55 PM > To: Haldar, Shouvanik > Cc: [EMAIL PROTECTED] > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > there is no master/slave architecture now > > its a simple conf file like below <@EOM> and then just start the agent. it will do needful > you need to start flume like the command below > > > > > bin/flume-ng agent --conf-file example.conf --name agent1 > > > agent1.sources = tail > agent1.channels = MemoryChannel-2 > agent1.sinks = HDFS > agent1.sources.tail.type = exec > agent1.sources.tail.command = tail -F <file> > agent1.sources.tail.channels = MemoryChannel-2 > agent1.sources.tail.interceptors = hostint > agent1.sources.tail.interceptors.hostint.type = org.apache.flume.interceptor.HostInterceptor$Builder > agent1.sources.tail.interceptors.hostint.preserveExisting = true > agent1.sources.tail.interceptors.hostint.useIP = true > agent1.sinks.HDFS.channel = MemoryChannel-2 > agent1.sinks.HDFS.type = hdfs > agent1.sinks.HDFS.hdfs.path = hdfs://url:8020/user/flume/%{host} > agent1.sinks.HDFS.hdfs.file.Type = SequenceFile > agent1.sinks.HDFS.hdfs.writeFormat = Text > agent1.sinks.HDFS.hdfs.rollInterval = 30 > agent1.sinks.HDFS.hdfs.rollCount = 0 > agent1.sinks.HDFS.hdfs.rollSize = 5000000000 > agent1.channels.MemoryChannel-2.type = memory > > more examples at http://flume.apache.org/FlumeUserGuide.html > > > On Tue, Dec 11, 2012 at 12:44 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: > Hi, > I installed flume 1.x higher version today! But is this very much different from the earlier. ? Is there no master / node concept here? How do I configure the source and sink? > > Think I got screwed here! > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> > > From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] > Sent: Monday, December 10, 2012 3:34 PM > > To: Haldar, Shouvanik > Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > just a random question, does the user running flume agent have permission to read the event details out of terracotta ? > > from the code here http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera/flume-core/0.9.4-cdh4.1.0/com/cloudera/flume/watchdog/Watchdog.java > > line 209 onwards, it looks like the error condition is achieved when you have channel set as stdin (I am not sure about this so you may need to look at code which part of code you are hitting depending on the flume configs you have) > > > > On Mon, Dec 10, 2012 at 3:01 PM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: > Hello, > > I am sure, the problem is due to Terracotta. Can you please help me? > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568<tel:%2B91-9830017568> > > From: Nitin Pawar [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>] > Sent: Monday, December 10, 2012 2:43 PM > To: Haldar, Shouvanik > Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]> > > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF +
Alexander Alten-Lorenz 2012-12-11, 07:33
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 08:11
Hi,
This error is removed. I copied flume-node as flume-master, replace all "node" with "master" and thus it worked! Thanks Now, I am facing a new weird error. I had mentioned source and sink. Now, Flume node status is set to "OPENING" and nothing else is happening even I do a refresh. In the flume-master console, I executed the below mentioned commands at the "Configure multiple nodes" textarea! Please help me. Which logs should I check! Commands at "Configure multiple nodes" textarea --------------------------------------------------- ec2-75-101-165-36.compute-1.amazonaws.com:tail("/var/log/flume/test1.log")|agentBESink("ec2-75-101-165-36.compute-1.amazonaws.com",35853); ec2-75-101-165-36.compute-1.amazonaws.com:collectorSource(35853)|EHCacheSink("Y","/var/log/flume"); When I tail the log at "/var/log/flume/flume-flume-node-ip-10-40-222-77.log", the logs don't move after "2012-12-11 02:59:48,598 INFO com.cloudera.flume.conf.SinkFactoryImpl: Found sink decorator EHCacheDecorator in com.EHCacheDecorator 2012-12-11 02:59:48,644 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Wed Dec 31 19:00:00 EST 1969' snkVer:'Wed Dec 31 19:00:00 EST 1969' ts='Wed Dec 31 19:00:00 EST 1969' flowId:'null' source:'null' sink:'null' } 2012-12-11 02:59:48,771 INFO com.cloudera.flume.agent.FlumeNode: Hadoop Security enabled: false 2012-12-11 02:59:53,484 INFO com.EHCacheSink: EHCacheSink: setting EHCache Debug=Y debugfilePath=/var/log/flume 2012-12-11 02:59:53,486 INFO com.cloudera.flume.collector.CollectorSource: opened 2012-12-11 02:59:53,486 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Tue Dec 11 02:55:27 EST 2012' snkVer:'Tue Dec 11 02:55:27 EST 2012' ts='Tue Dec 11 02:55:27 EST 2012' flowId:'default-flow' source:'collectorSource( 35853 )' sink:'EHCacheSink( "Y", "/var/log/flume" )' } 2012-12-11 02:59:53,498 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853..." When I do a "netstat -nlp| grep 35853" I get "[root@ip-10-40-222-77 bin]# netstat -nlp| grep 35853 tcp 0 0 :::35853 :::* LISTEN 21096/java " Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Alexander Alten-Lorenz [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 11, 2012 1:03 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Hi, yum remove --force <paketname> Or simply create a empty file called /etc/init.d/flume-master: echo "foo" > /etc/init.d/flume-master best - Alex On Dec 11, 2012, at 8:27 AM, [EMAIL PROTECTED] wrote: > Hi, > > Can you please help me on one thing! Mistakenly deleted /etc/init.d/flume-master script. Now flume-master is not getting uninstalled or removed! Please help! > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > From: Nitin Pawar [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, December 11, 2012 12:55 PM > To: Haldar, Shouvanik > Cc: [EMAIL PROTECTED] > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > there is no master/slave architecture now > > its a simple conf file like below <@EOM> and then just start the agent. it will do needful > you need to start flume like the command below > > > > > bin/flume-ng agent --conf-file example.conf --name agent1 > > > agent1.sources = tail > agent1.channels = MemoryChannel-2 > agent1.sinks = HDFS > agent1.sources.tail.type = exec > agent1.sources.tail.command = tail -F <file> > agent1.sources.tail.channels = MemoryChannel-2 > agent1.sources.tail.interceptors = hostint > agent1.sources.tail.interceptors.hostint.type = org.apache.flume.interceptor.HostInterceptor$Builder Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF +
shouvanik.haldar@... 2012-12-11, 08:11
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Brock Noland 2012-12-10, 12:42
Hi,
Just to echo Nitin, Flume 1.X is what the community is moving forward with so you will likely find more support from the community on that version. I'd highly recommend upgrading. Cheers, Brock On Mon, Dec 10, 2012 at 3:13 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote: > I just hope you are not hitting this > https://issues.apache.org/jira/browse/FLUME-796 > I would also like to recommend you to upgraded to flume 1.x asap > > if possible can you try changing your flume source to some random file with > tail -f and try sinking it to some file. That will narrow the problem is on > flume side or terracotta side > > Thanks, > Nitin > > > On Mon, Dec 10, 2012 at 1:47 PM, <[EMAIL PROTECTED]> wrote: >> >> Hi, >> >> >> >> I am using Flume -> Flume 0.9.4-cdh3u5. >> >> >> >> Initially, the logs are ok. But when I start terracotta >> (./start-tc-server.sh) , then only I experience the above phenomena! Is it >> something to do with terracotta.! >> >> >> >> >> >> 2012-12-10 03:14:08,806 INFO >> com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking >> thread pool server on port 35853... >> >> 2012-12-10 03:14:08,894 INFO net.sf.ehcache.terracotta.TerracottaClient: >> Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] >> [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory >> >> >> >> Before starting terracotta, Flume Node status is “OPENING”. >> >> But when I start terracotta, I got the error “INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1” >> >> >> >> Please help ! >> >> >> >> >> >> Thanks and Regards, >> >> Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 >> >> >> >> From: Nitin Pawar [mailto:[EMAIL PROTECTED]] >> Sent: Monday, December 10, 2012 12:52 PM >> To: [EMAIL PROTECTED] >> Cc: Haldar, Shouvanik >> Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> >> >> what version of flume are you using? If it is < 1.x then recommend you to >> upgrade to latest 1.0.3 >> >> If you are on 1.x then can you tell us whats the hostname for your server? >> >> >> >> On Mon, Dec 10, 2012 at 11:40 AM, <[EMAIL PROTECTED]> wrote: >> >> Before the below mentioned error, I get a success message like >> >> >> >> 2012-12-10 01:09:14,403 INFO net.sf.ehcache.terracotta.TerracottaClient: >> Thread [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] >> [cacheManager: 'RTLogCacheManager']: Creating new ClusteredInstanceFactory >> >> >> >> Thanks and Regards, >> >> Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 >> >> >> >> From: Haldar, Shouvanik >> Sent: Monday, December 10, 2012 11:34 AM >> To: '[EMAIL PROTECTED]' >> Subject: Getting weird error -> 2012-12-10 01:01:42,190 INFO >> com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 >> >> >> >> I had configured flume-master as well as flume-node on a single machine. >> >> Now, as I run terracotta -> L1 cache, I get the INFO below in / >> >> >> >> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: >> Subprocess exited with value 1 >> >> >> >> Can you please help? I am struggling with this for the past 1 day without >> success! >> >> >> >> Thanks and Regards, >> >> Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 >> >> >> >> >> >> ________________________________ >> >> This message is for the designated recipient only and may contain >> privileged, proprietary, or otherwise private information. If you have >> received it in error, please notify the sender immediately and delete the >> original. Any other use of the e-mail by you is prohibited. >> >> Where allowed by local law, electronic communications with Accenture and >> its affiliates, including e-mail and instant messaging (including content), >> may be scanned by our systems for the purposes of information security and >> assessment of internal compliance with Accenture policy. Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/ +
Brock Noland 2012-12-10, 12:42
-
Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-10, 06:04
I had configured flume-master as well as flume-node on a single machine.
Now, as I run terracotta -> L1 cache, I get the INFO below in / 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Can you please help? I am struggling with this for the past 1 day without success! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise private information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com +
shouvanik.haldar@... 2012-12-10, 06:04
-
FW: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 12:45
Also, when I check the terracotta logs at "/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log", I get the error as
"2012-12-11 07:44:44,000 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@341752521 2012-12-11 07:44:54,700 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@431432310 2012-12-11 07:45:05,071 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@1169921331" Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 6:13 PM To: '[EMAIL PROTECTED]' Cc: '[EMAIL PROTECTED]' Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Getting a weird error in "/usr/lib/flume/logs-10.40.222.77/terracotta-client.log". The error says "2012-12-11 07:31:13,909 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.terracottatech.console - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key 2012-12-11 07:31:13,914 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.tc.license.LicenseManager - License key not found org.terracotta.license.LicenseException" But, I am sure and it shows in terracotta log that license key is getting loaded from the location "2012-12-11 07:29:48,712 INFO - Terracotta Enterprise 3.6.1, as of 20120125-122228 (Revision 15328-19619 by cruise@su10vmo104 from 3.6.1) 2012-12-11 07:29:49,300 INFO - Successfully loaded base configuration from file at '/mnt/terracotta-ee-3.6.1/bin/tc-config.xml'. 2012-12-11 07:29:49,363 INFO - Log file: '/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log'. 2012-12-11 07:29:49,422 INFO - Terracotta license loaded from /mnt/terracotta-ee-3.6.1/terracotta-license.key Capabilities: DCV2, TMC, authentication, ehcache, ehcache offheap, operator console, quartz, quartz manager, quartz where, roots, search, security, server array offheap, server striping, sessions Date of Issue: 2012-09-24 Edition: FX Expiration Date: 2012-12-31 License Number: Download Trial License - Accept License Type: Trial Licensee: Download Trial License - Accept Max Client Count: 50 Product: Enterprise Suite ehcache.maxOffHeap: 250G terracotta.serverArray.maxOffHeap: 250G 2012-12-11 07:29:51,857 INFO - Available Max Runtime Memory: 490MB 2012-12-11 07:29:54,228 INFO - JMX Server started. Available at URL[service:jmx:jmxmp://0.0.0.0:9520] 2012-12-11 07:30:01,233 INFO - Becoming State[ ACTIVE-COORDINATOR ] 2012-12-11 07:30:01,312 INFO - Terracotta Server instance has started up as ACTIVE node on 0:0:0:0:0:0:0:0:9510 successfully, and is now ready for work." But, when I see the logs at "/var/log/flume/flume-flume-node-ip-10-40-222-77.out", I get the error as "2012-12-11 07:31:13,909 ERROR - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key" Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 2:05 PM To: '[EMAIL PROTECTED]'; '[EMAIL PROTECTED]' Cc: Haldar, Shouvanik Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 The previous error is now resolved. Actually some jars were missing which flume requires. Some errors are still there..I will let you know in a short while. Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 1:42 PM To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Hi, This error is removed. I copied flume-node as flume-master, replace all "node" with "master" and thus it worked! Thanks Now, I am facing a new weird error. I had mentioned source and sink. Now, Flume node status is set to "OPENING" and nothing else is happening even I do a refresh. In the flume-master console, I executed the below mentioned commands at the "Configure multiple nodes" textarea! Please help me. Which logs should I check! Commands at "Configure multiple nodes" textarea ec2-75-101-165-36.compute-1.amazonaws.com:tail("/var/log/flume/test1.log")|agentBESink("ec2-75-101-165-36.compute-1.amazonaws.com",35853); ec2-75-101-165-36.compute-1.amazonaws.com:collectorSource(35853)|EHCacheSink("Y","/var/log/flume"); When I tail the log at "/var/log/flume/flume-flume-node-ip-10-40-222-77.log", the logs don't move after "2012-12-11 02:59:48,598 INFO com.cloudera.flume.conf.SinkFactoryImpl: Found sink decorator EHCacheDecorator in com.EHCacheDecorator 2012-12-11 02:59:48,644 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Wed Dec 31 19:00:00 EST 1969' snkVer:'Wed Dec 31 19:00:00 EST 1969' ts='Wed Dec 31 19:00:00 EST 1969' flowId:'null' source:'null' sink:'null' } 2012-12-11 02:59:48,771 INFO com.cloudera.flume.agent.FlumeNode: Hadoop Security enabled: false 2012-12-11 02:59:53,484 INFO com.EHCacheSink: EHCacheSink: setting EHCache Debug=Y debugfilePath=/var/log/flume 2012-12-11 02:59:53,486 INFO com.cloudera.flume.collector.CollectorSource: opened 2012-12-11 02:59:53,486 INFO com.cloudera.flume.agent.LogicalNode: Node config succ +
shouvanik.haldar@... 2012-12-11, 12:45
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1Alexander Alten-Lorenz 2012-12-11, 13:40
May you ask terracotta forums?
http://forums.terracotta.org/forums/forums/list.page And again - we strongly kick you into Flume 1.x. Flume 0.9x will getting only security updates, when ever. Regards, Alex On Dec 11, 2012, at 1:45 PM, [EMAIL PROTECTED] wrote: > Also, when I check the terracotta logs at "/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log", I get the error as > > "2012-12-11 07:44:44,000 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@341752521 > 2012-12-11 07:44:54,700 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@431432310 > 2012-12-11 07:45:05,071 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@1169921331" > > > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- > From: Haldar, Shouvanik > Sent: Tuesday, December 11, 2012 6:13 PM > To: '[EMAIL PROTECTED]' > Cc: '[EMAIL PROTECTED]' > Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > Getting a weird error in "/usr/lib/flume/logs-10.40.222.77/terracotta-client.log". > > > The error says > > "2012-12-11 07:31:13,909 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.terracottatech.console - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key > 2012-12-11 07:31:13,914 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.tc.license.LicenseManager - License key not found > org.terracotta.license.LicenseException" > > But, I am sure and it shows in terracotta log that license key is getting loaded from the location > > "2012-12-11 07:29:48,712 INFO - Terracotta Enterprise 3.6.1, as of 20120125-122228 (Revision 15328-19619 by cruise@su10vmo104 from 3.6.1) > 2012-12-11 07:29:49,300 INFO - Successfully loaded base configuration from file at '/mnt/terracotta-ee-3.6.1/bin/tc-config.xml'. > 2012-12-11 07:29:49,363 INFO - Log file: '/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log'. > 2012-12-11 07:29:49,422 INFO - Terracotta license loaded from /mnt/terracotta-ee-3.6.1/terracotta-license.key > Capabilities: DCV2, TMC, authentication, ehcache, ehcache offheap, operator console, quartz, quartz manager, quartz where, roots, search, security, server array offheap, server striping, sessions > Date of Issue: 2012-09-24 > Edition: FX > Expiration Date: 2012-12-31 > License Number: Download Trial License - Accept > License Type: Trial > Licensee: Download Trial License - Accept > Max Client Count: 50 > Product: Enterprise Suite > ehcache.maxOffHeap: 250G > terracotta.serverArray.maxOffHeap: 250G > > 2012-12-11 07:29:51,857 INFO - Available Max Runtime Memory: 490MB > 2012-12-11 07:29:54,228 INFO - JMX Server started. Available at URL[service:jmx:jmxmp://0.0.0.0:9520] > 2012-12-11 07:30:01,233 INFO - Becoming State[ ACTIVE-COORDINATOR ] > 2012-12-11 07:30:01,312 INFO - Terracotta Server instance has started up as ACTIVE node on 0:0:0:0:0:0:0:0:9510 successfully, and is now ready for work." > > > But, when I see the logs at "/var/log/flume/flume-flume-node-ip-10-40-222-77.out", I get the error as > > "2012-12-11 07:31:13,909 ERROR - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key" > > Please help! > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF +
Alexander Alten-Lorenz 2012-12-11, 13:40
-
Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 13:48
Due to some constraints i have to get application up and running for flume 0.x.
Once app is up, i will surely try flume 1.x. Shouvanik Sent from Samsung mobile Alexander Alten-Lorenz <[EMAIL PROTECTED]> wrote: May you ask terracotta forums? http://forums.terracotta.org/forums/forums/list.page And again - we strongly kick you into Flume 1.x. Flume 0.9x will getting only security updates, when ever. Regards, Alex On Dec 11, 2012, at 1:45 PM, [EMAIL PROTECTED] wrote: > Also, when I check the terracotta logs at "/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log", I get the error as > > "2012-12-11 07:44:44,000 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@341752521 > 2012-12-11 07:44:54,700 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@431432310 > 2012-12-11 07:45:05,071 [L2_L1:TCComm Main Selector Thread_R (listen 0:0:0:0:0:0:0:0:9510)] INFO com.tc.net.core.CoreNIOServices - selection key cancelled key@1169921331" > > > > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > > -----Original Message----- > From: Haldar, Shouvanik > Sent: Tuesday, December 11, 2012 6:13 PM > To: '[EMAIL PROTECTED]' > Cc: '[EMAIL PROTECTED]' > Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > Getting a weird error in "/usr/lib/flume/logs-10.40.222.77/terracotta-client.log". > > > The error says > > "2012-12-11 07:31:13,909 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.terracottatech.console - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key > 2012-12-11 07:31:13,914 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.tc.license.LicenseManager - License key not found > org.terracotta.license.LicenseException" > > But, I am sure and it shows in terracotta log that license key is getting loaded from the location > > "2012-12-11 07:29:48,712 INFO - Terracotta Enterprise 3.6.1, as of 20120125-122228 (Revision 15328-19619 by cruise@su10vmo104 from 3.6.1) > 2012-12-11 07:29:49,300 INFO - Successfully loaded base configuration from file at '/mnt/terracotta-ee-3.6.1/bin/tc-config.xml'. > 2012-12-11 07:29:49,363 INFO - Log file: '/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log'. > 2012-12-11 07:29:49,422 INFO - Terracotta license loaded from /mnt/terracotta-ee-3.6.1/terracotta-license.key > Capabilities: DCV2, TMC, authentication, ehcache, ehcache offheap, operator console, quartz, quartz manager, quartz where, roots, search, security, server array offheap, server striping, sessions > Date of Issue: 2012-09-24 > Edition: FX > Expiration Date: 2012-12-31 > License Number: Download Trial License - Accept > License Type: Trial > Licensee: Download Trial License - Accept > Max Client Count: 50 > Product: Enterprise Suite > ehcache.maxOffHeap: 250G > terracotta.serverArray.maxOffHeap: 250G > > 2012-12-11 07:29:51,857 INFO - Available Max Runtime Memory: 490MB > 2012-12-11 07:29:54,228 INFO - JMX Server started. Available at URL[service:jmx:jmxmp://0.0.0.0:9520] > 2012-12-11 07:30:01,233 INFO - Becoming State[ ACTIVE-COORDINATOR ] > 2012-12-11 07:30:01,312 INFO - Terracotta Server instance has started up as ACTIVE node on 0:0:0:0:0:0:0:0:9510 successfully, and is now ready for work." > > > But, when I see the logs at "/var/log/flume/flume-flume-node-ip-10-40-222-77.out", I get the error as > > "2012-12-11 07:31:13,909 ERROR - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key" Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF +
shouvanik.haldar@... 2012-12-11, 13:48
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 12:43
Getting a weird error in "/usr/lib/flume/logs-10.40.222.77/terracotta-client.log".
The error says "2012-12-11 07:31:13,909 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.terracottatech.console - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key 2012-12-11 07:31:13,914 [logicalNode ec2-75-101-165-36.compute-1.amazonaws.com-19] ERROR com.tc.license.LicenseManager - License key not found org.terracotta.license.LicenseException" But, I am sure and it shows in terracotta log that license key is getting loaded from the location "2012-12-11 07:29:48,712 INFO - Terracotta Enterprise 3.6.1, as of 20120125-122228 (Revision 15328-19619 by cruise@su10vmo104 from 3.6.1) 2012-12-11 07:29:49,300 INFO - Successfully loaded base configuration from file at '/mnt/terracotta-ee-3.6.1/bin/tc-config.xml'. 2012-12-11 07:29:49,363 INFO - Log file: '/mnt/terracotta-ee-3.6.1/bin/logs/terracotta-server.log'. 2012-12-11 07:29:49,422 INFO - Terracotta license loaded from /mnt/terracotta-ee-3.6.1/terracotta-license.key Capabilities: DCV2, TMC, authentication, ehcache, ehcache offheap, operator console, quartz, quartz manager, quartz where, roots, search, security, server array offheap, server striping, sessions Date of Issue: 2012-09-24 Edition: FX Expiration Date: 2012-12-31 License Number: Download Trial License - Accept License Type: Trial Licensee: Download Trial License - Accept Max Client Count: 50 Product: Enterprise Suite ehcache.maxOffHeap: 250G terracotta.serverArray.maxOffHeap: 250G 2012-12-11 07:29:51,857 INFO - Available Max Runtime Memory: 490MB 2012-12-11 07:29:54,228 INFO - JMX Server started. Available at URL[service:jmx:jmxmp://0.0.0.0:9520] 2012-12-11 07:30:01,233 INFO - Becoming State[ ACTIVE-COORDINATOR ] 2012-12-11 07:30:01,312 INFO - Terracotta Server instance has started up as ACTIVE node on 0:0:0:0:0:0:0:0:9510 successfully, and is now ready for work." But, when I see the logs at "/var/log/flume/flume-flume-node-ip-10-40-222-77.out", I get the error as "2012-12-11 07:31:13,909 ERROR - Terracotta license key is required for Enterprise capabilities. Please place terracotta-license.key in Terracotta installed directory or in resource path. You could also specify it through system property -Dcom.tc.productkey.path=/path/to/key" Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 2:05 PM To: '[EMAIL PROTECTED]'; '[EMAIL PROTECTED]' Cc: Haldar, Shouvanik Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 The previous error is now resolved. Actually some jars were missing which flume requires. Some errors are still there..I will let you know in a short while. Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 1:42 PM To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Hi, This error is removed. I copied flume-node as flume-master, replace all "node" with "master" and thus it worked! Thanks Now, I am facing a new weird error. I had mentioned source and sink. Now, Flume node status is set to "OPENING" and nothing else is happening even I do a refresh. In the flume-master console, I executed the below mentioned commands at the "Configure multiple nodes" textarea! Please help me. Which logs should I check! Commands at "Configure multiple nodes" textarea --------------------------------------------------- ec2-75-101-165-36.compute-1.amazonaws.com:tail("/var/log/flume/test1.log")|agentBESink("ec2-75-101-165-36.compute-1.amazonaws.com",35853); ec2-75-101-165-36.compute-1.amazonaws.com:collectorSource(35853)|EHCacheSink("Y","/var/log/flume"); When I tail the log at "/var/log/flume/flume-flume-node-ip-10-40-222-77.log", the logs don't move after "2012-12-11 02:59:48,598 INFO com.cloudera.flume.conf.SinkFactoryImpl: Found sink decorator EHCacheDecorator in com.EHCacheDecorator 2012-12-11 02:59:48,644 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Wed Dec 31 19:00:00 EST 1969' snkVer:'Wed Dec 31 19:00:00 EST 1969' ts='Wed Dec 31 19:00:00 EST 1969' flowId:'null' source:'null' sink:'null' } 2012-12-11 02:59:48,771 INFO com.cloudera.flume.agent.FlumeNode: Hadoop Security enabled: false 2012-12-11 02:59:53,484 INFO com.EHCacheSink: EHCacheSink: setting EHCache Debug=Y debugfilePath=/var/log/flume 2012-12-11 02:59:53,486 INFO com.cloudera.flume.collector.CollectorSource: opened 2012-12-11 02:59:53,486 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Tue Dec 11 02:55:27 EST 2012' snkVer:'Tue Dec 11 02:55:27 EST 2012' ts='Tue Dec 11 02:55:27 EST 2012' flowId:'default-flow' source:'collectorSource( 35853 )' sink:'EHCacheSink( "Y", "/var/log/flume" )' } 2012-12-11 02:59:53,498 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853..." When I do a "netstat -nlp| grep 35853" I get "[root@ip-10-40-222-77 bin]# netstat -nlp| grep 35853 tcp 0 0 :::35853 :::* LISTEN 21096/java " Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 From: Alexander Alten-Lorenz [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 11, 2012 1:03 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.wa +
shouvanik.haldar@... 2012-12-11, 12:43
-
RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1shouvanik.haldar@... 2012-12-11, 08:35
The previous error is now resolved. Actually some jars were missing which flume requires. Some errors are still there..I will let you know in a short while.
Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Haldar, Shouvanik Sent: Tuesday, December 11, 2012 1:42 PM To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: RE: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Hi, This error is removed. I copied flume-node as flume-master, replace all "node" with "master" and thus it worked! Thanks Now, I am facing a new weird error. I had mentioned source and sink. Now, Flume node status is set to "OPENING" and nothing else is happening even I do a refresh. In the flume-master console, I executed the below mentioned commands at the "Configure multiple nodes" textarea! Please help me. Which logs should I check! Commands at "Configure multiple nodes" textarea --------------------------------------------------- ec2-75-101-165-36.compute-1.amazonaws.com:tail("/var/log/flume/test1.log")|agentBESink("ec2-75-101-165-36.compute-1.amazonaws.com",35853); ec2-75-101-165-36.compute-1.amazonaws.com:collectorSource(35853)|EHCacheSink("Y","/var/log/flume"); When I tail the log at "/var/log/flume/flume-flume-node-ip-10-40-222-77.log", the logs don't move after "2012-12-11 02:59:48,598 INFO com.cloudera.flume.conf.SinkFactoryImpl: Found sink decorator EHCacheDecorator in com.EHCacheDecorator 2012-12-11 02:59:48,644 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Wed Dec 31 19:00:00 EST 1969' snkVer:'Wed Dec 31 19:00:00 EST 1969' ts='Wed Dec 31 19:00:00 EST 1969' flowId:'null' source:'null' sink:'null' } 2012-12-11 02:59:48,771 INFO com.cloudera.flume.agent.FlumeNode: Hadoop Security enabled: false 2012-12-11 02:59:53,484 INFO com.EHCacheSink: EHCacheSink: setting EHCache Debug=Y debugfilePath=/var/log/flume 2012-12-11 02:59:53,486 INFO com.cloudera.flume.collector.CollectorSource: opened 2012-12-11 02:59:53,486 INFO com.cloudera.flume.agent.LogicalNode: Node config successfully set to FlumeConfigData: {srcVer:'Tue Dec 11 02:55:27 EST 2012' snkVer:'Tue Dec 11 02:55:27 EST 2012' ts='Tue Dec 11 02:55:27 EST 2012' flowId:'default-flow' source:'collectorSource( 35853 )' sink:'EHCacheSink( "Y", "/var/log/flume" )' } 2012-12-11 02:59:53,498 INFO com.cloudera.flume.handlers.thrift.ThriftEventSource: Starting blocking thread pool server on port 35853..." When I do a "netstat -nlp| grep 35853" I get "[root@ip-10-40-222-77 bin]# netstat -nlp| grep 35853 tcp 0 0 :::35853 :::* LISTEN 21096/java " Please help! Thanks and Regards, Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 -----Original Message----- From: Alexander Alten-Lorenz [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 11, 2012 1:03 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 Hi, yum remove --force <paketname> Or simply create a empty file called /etc/init.d/flume-master: echo "foo" > /etc/init.d/flume-master best - Alex On Dec 11, 2012, at 8:27 AM, [EMAIL PROTECTED] wrote: > Hi, > > Can you please help me on one thing! Mistakenly deleted /etc/init.d/flume-master script. Now flume-master is not getting uninstalled or removed! Please help! > > Thanks and Regards, > Shouvanik Haldar | Cloud SME Pool | Mobile:+91-9830017568 > > From: Nitin Pawar [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, December 11, 2012 12:55 PM > To: Haldar, Shouvanik > Cc: [EMAIL PROTECTED] > Subject: Re: Getting weird error -> 2012-12-10 01:01:42,190 INFO com.cloudera.flume.watchdog.Watchdog: Subprocess exited with value 1 > > there is no master/slave architecture now > Alexander Alten-Lorenz http://mapredit.blogspot.com German Hadoop LinkedIn Group: http://goo.gl/N8pCF +
shouvanik.haldar@... 2012-12-11, 08:35
|