Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Web Log Analysis

karanveer.singh@... 2012-04-10, 17:40
Copy link to this message
Re: Web Log Analysis
as per my knowledge there are no such in build udf, cause log files come as
their own formats as required by the organization etc

In our case, we just have a log processor system which converts the log
file into flat file tabular format which we load later in hive also you can
have a mapred job which processes the logs and insert the records in hive
tables and then u can have them ready for analysis

On Tue, Apr 10, 2012 at 11:10 PM, <[EMAIL PROTECTED]> wrote:

> Hi,
> Are there some UDF's in hive which will allow us to do quick analysis of
> web logs like click stream, unique visits, etc.
> Rgds,
> Karan
> This e-mail and any attachments are confidential and intended
> solely for the addressee and may also be privileged or exempt from
> disclosure under applicable law. If you are not the addressee, or
> have received this e-mail in error, please notify the sender
> immediately, delete it from your system and do not copy, disclose
> or otherwise act upon any part of this e-mail or its attachments.
> Internet communications are not guaranteed to be secure or
> virus-free.
> The Barclays Group does not accept responsibility for any loss
> arising from unauthorised access to, or interference with, any
> Internet communications by any third party, or from the
> transmission of any viruses. Replies to this e-mail may be
> monitored by the Barclays Group for operational or business
> reasons.
> Any opinion or other information in this e-mail or its attachments
> that does not relate to the business of the Barclays Group is
> personal to the sender and is not given or endorsed by the Barclays
> Group.
> Barclays Bank PLC. Registered in England and Wales (registered no.
> 1026167).
> Registered Office: 1 Churchill Place, London, E14 5HP, United
> Kingdom.
> Barclays Bank PLC is authorised and regulated by the Financial
> Services Authority.

Nitin Pawar