Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Web Log Analysis

Copy link to this message
Re: Web Log Analysis
Nitin Pawar 2012-04-10, 17:51
as per my knowledge there are no such in build udf, cause log files come as
their own formats as required by the organization etc

In our case, we just have a log processor system which converts the log
file into flat file tabular format which we load later in hive also you can
have a mapred job which processes the logs and insert the records in hive
tables and then u can have them ready for analysis

On Tue, Apr 10, 2012 at 11:10 PM, <[EMAIL PROTECTED]> wrote:

> Hi,
> Are there some UDF's in hive which will allow us to do quick analysis of
> web logs like click stream, unique visits, etc.
> Rgds,
> Karan
> This e-mail and any attachments are confidential and intended
> solely for the addressee and may also be privileged or exempt from
> disclosure under applicable law. If you are not the addressee, or
> have received this e-mail in error, please notify the sender
> immediately, delete it from your system and do not copy, disclose
> or otherwise act upon any part of this e-mail or its attachments.
> Internet communications are not guaranteed to be secure or
> virus-free.
> The Barclays Group does not accept responsibility for any loss
> arising from unauthorised access to, or interference with, any
> Internet communications by any third party, or from the
> transmission of any viruses. Replies to this e-mail may be
> monitored by the Barclays Group for operational or business
> reasons.
> Any opinion or other information in this e-mail or its attachments
> that does not relate to the business of the Barclays Group is
> personal to the sender and is not given or endorsed by the Barclays
> Group.
> Barclays Bank PLC. Registered in England and Wales (registered no.
> 1026167).
> Registered Office: 1 Churchill Place, London, E14 5HP, United
> Kingdom.
> Barclays Bank PLC is authorised and regulated by the Financial
> Services Authority.

Nitin Pawar