Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - where to Find flume-ng logs


+
GuoWei 2013-01-02, 05:45
+
Alexander Alten-Lorenz 2013-01-02, 07:23
+
GuoWei 2013-01-02, 10:00
+
Alexander Alten-Lorenz 2013-01-02, 11:17
Copy link to this message
-
Re: where to Find flume-ng logs
Connor Woodson 2013-01-02, 22:41
Here's the command you should use to run flume:

*/path/to/flume-ng agent —name host1 **--conf /home/hadoop/flume-ng/conf **
-f /home/hadoop/flume-ng/conf/razor.conf *
And if you want to manually specify the location of the logs, you can
either hard code it into the log4j.properties or you can remove the line
"flume.log.dir=./log" from that file (don't know if that's necessary) and
then add the following to the end of your flume command:

-Dflume.log.dir=/log/dir

- Connor

On Wed, Jan 2, 2013 at 3:17 AM, Alexander Alten-Lorenz
<[EMAIL PROTECTED]>wrote:

> Hi,
>
> You've to add the log4j.properties into the classpath:
>
> bin/flume-ng agent -n <agent> -f <configfile> --conf <config directory>
>
> <config directory> means the directory where log4j.properties is located
>
> In log4j.properties be sure you've the correct path:
>
> flume.root.logger=INFO,LOGFILE
> flume.log.dir=./logs
> flume.log.file=flume.log
>
> - Alex
>
> On Jan 2, 2013, at 11:00 AM, GuoWei <[EMAIL PROTECTED]> wrote:
>
> > Hello, Alexander,
> >
> > I start flume from the root directory ex: /home/hadoop/flume-ng.
> > And I also make logs directory in flume-mg directory. And give the logs
> > folder 777 permission.
> > But I still can not see the log files under logs directory.
> >
> > I can view the log from the console. But never get the log file.
> >
> > Any wrong configurations ?
> >
> > Thanks
> >
> >
> >
> >
> > On 13-1-2 下午3:23, "Alexander Alten-Lorenz" <[EMAIL PROTECTED]> wrote:
> >
> >> Hi.
> >>
> >> "./logs" means in the directory, from where you start flume, in the
> >> subdirectory "logs".
> >>
> >> Best,
> >> Alex
> >>
> >> On Jan 2, 2013, at 6:45 AM, GuoWei <[EMAIL PROTECTED]> wrote:
> >>
> >>> Hello,
> >>>
> >>> I use flume-mg 1.3 to collect logs and user Hbase Sink to store data to
> >>> Hbase. And I want to see flume-ng logs. But I can not find log under
> >>> flume-ng root directory. My log4j.properties configure the log
> >>> directory as
> >>> default "./logs".
> >>>
> >>> And I start flume-ng as following:
> >>>> Flume-ng agent ‹name host1 ‹conf-file
> >>>> /home/hadoop/flume-ng/conf/razor.conf
> >>>
> >>> Thanks a lot
> >>> Regards
> >>>
> >>>
> >>
> >>
> >
> >
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
+
GuoWei 2013-01-03, 02:47
+
Abhijeet Pathak 2013-01-04, 10:01
+
Alexander Alten-Lorenz 2013-01-04, 10:30