Flume, mail # user - Any Refernce to complete implementation of maintaining simple log files from single app source

Any Refernce to complete implementation of maintaining simple log files from single app source

yogi nerella 2013-01-25, 18:35

Hi,

Any one uses the end to end solution?

1. Capturing the log files.

2. Saving them to either HDFS or CassendraFileSystem.

3. Querying the data from the log files using a web interface?

Yogi

Re: Any Refernce to complete implementation of maintaining simple log files from single app source

Alexander Alten-Lorenz 2013-01-25, 19:44

Hi,

Flume -> HDFS Sink -> Hive (Beeswax). Out of the box.

- Alex
On Jan 25, 2013, at 7:35 PM, yogi nerella <[EMAIL PROTECTED]> wrote:

> Hi,
>
> Any one uses the end to end solution?
>
> 1. Capturing the log files.
>
> 2. Saving them to either HDFS or CassendraFileSystem.
>
> 3. Querying the data from the log files using a web interface?
>
> Yogi

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

Re: Any Refernce to complete implementation of maintaining simple log files from single app source

yogi nerella 2013-01-25, 20:53

Hi Alex,

I am new to the HDFS, Hive technologies. Do they have a good UI to query
the information from the database.

Thx,
Yogi
On Fri, Jan 25, 2013 at 11:44 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:

> Hi,
>
> Flume -> HDFS Sink -> Hive (Beeswax). Out of the box.
>
> - Alex
>
>
> On Jan 25, 2013, at 7:35 PM, yogi nerella <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Any one uses the end to end solution?
> >
> > 1. Capturing the log files.
> >
> > 2. Saving them to either HDFS or CassendraFileSystem.
> >
> > 3. Querying the data from the log files using a web interface?
> >
> > Yogi
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>

Re: Any Refernce to complete implementation of maintaining simple log files from single app source

Alexander Alten-Lorenz 2013-01-26, 08:07

Hey Yogi,

Yes, Beeswax is very usable, just give them a try.
Here you have a Slideshare from Carl, but the UI looks much nicer now. Just to give you a idea:
http://www.slideshare.net/cwsteinbach/cloudera-huebeeswax

- Alex

On Jan 25, 2013, at 9:53 PM, yogi nerella <[EMAIL PROTECTED]> wrote:

> Hi Alex,
>
> I am new to the HDFS, Hive technologies. Do they have a good UI to query
> the information from the database.
>
> Thx,
> Yogi
>
>
> On Fri, Jan 25, 2013 at 11:44 AM, Alexander Alten-Lorenz <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> Flume -> HDFS Sink -> Hive (Beeswax). Out of the box.
>>
>> - Alex
>>
>>
>> On Jan 25, 2013, at 7:35 PM, yogi nerella <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>
>>> Any one uses the end to end solution?
>>>
>>> 1. Capturing the log files.
>>>
>>> 2. Saving them to either HDFS or CassendraFileSystem.
>>>
>>> 3. Querying the data from the log files using a web interface?
>>>
>>> Yogi
>>
>> --
>> Alexander Alten-Lorenz
>> http://mapredit.blogspot.com
>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>>
>>

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF