Hive, mail # user - RE: not able to access Hive Web Interface

not able to access Hive web Interface

yogesh.kumar13@... 2012-07-17, 12:36

Re: not able to access Hive web Interface

kulkarni.swarnim@...) 2012-07-17, 13:24

The problem is that it is probably looking for these files in HDFS instead
of your local file system. As a workaround, try creating that path on HDFS
and uploading these files there and see if it works. Also, try setting the
fs.default.name property in conf-site.xml to point to your local filesystem
instead of HDFS (file://.....).

PS: You can also directly do this from the hive command line itself.

hive> SET fs.default.name='file://`pwd`

But this would be temporary and limited to your current session.

Hope that helps.

On Tue, Jul 17, 2012 at 7:36 AM, <[EMAIL PROTECTED]> wrote:

> Hi all :-),
>
> Iam trying to access Hive Web Interface but it fails.
>
> I have this changes in hive-site.xml
>
>
> ************************************************************************************************
> <configuration>
> <property>
> <name>hive.hwi.listen.host</name>
> <value>0.0.0.0</value>
> <description>This is the host address the Hive Web Interface will
> listen on</description>
> </property>
>
> <property>
> <name>hive.hwi.listen.port</name>
> <value>9999</value>
> <description>This is the port the Hive Web Interface will listen
> on</description>
> </property>
>
> <property>
> <name>hive.hwi.war.file</name>
> <value>/HADOOP/hive/lib/hive-hwi-0.8.1.war</value> /* (Here is
> the hive directory) */
> <description>This is the WAR file with the jsp content for Hive
> Web Interface</description>
> </property>
>
> </configuration>
>
>
> ***********************************************************************************************
>
> And also export the ANT lib like.
>
> export ANT_LIB=/Yogesh/ant-1.8.4/lib
> export PATH=$PATH:$ANT_LIB
>
>
> now when i do run command
>
> hive --service hwi it results
>
> 12/07/17 18:03:02 INFO hwi.HWIServer: HWI is starting up
> 12/07/17 18:03:02 WARN conf.HiveConf: DEPRECATED: Ignoring
> hive-default.xml found on the CLASSPATH at
> /HADOOP/hive/conf/hive-default.xml
> 12/07/17 18:03:02 FATAL hwi.HWIServer: HWI WAR file not found at
> /HADOOP/hive/lib/hive-hwi-0.8.1.war
>
>
> and if I go for
>
> hive --service hwi --help it results
>
> Usage ANT_LIB=XXXX hive --service hwi
>
>
> Althought if I go to /HADOOP/hive/lib directory I found
>
> 1) hive-hwi-0.8.1.war
> 2) hive-hwi-0.8.1.jar
>
> these files are present there.
>
> what is Iam doing wrong :-( ?
>
> Please help and Suggest
>
> Greetings
> Yogesh Kumar
>
>
> * Please do not print this email unless it is absolutely necessary. *****
>
> The information contained in this electronic message and any attachments
> to this message are intended for the exclusive use of the addressee(s) and
> may contain proprietary, confidential or privileged information. If you are
> not the intended recipient, you should not disseminate, distribute or copy
> this e-mail. Please notify the sender immediately and destroy all copies of
> this message and any attachments.
>
> WARNING: Computer viruses can be transmitted via email. The recipient
> should check this email and any attachments for the presence of viruses.
> The company accepts no liability for any damage caused by any virus
> transmitted by this email.
>
> www.wipro.com
>

--
Swarnim

RE: not able to access Hive web Interface

yogesh.kumar13@... 2012-07-18, 06:16

Thanks Kulkarni,

I uploaded the hole hive directory and created path like.

Hadoop dfs -mkdir /HADOOP/
Hadoop dfs -put /HADOOP/hive /HADOOP/

and also tried

hive> SET fs.default.name='/HADOOP/hive/lib/'

but still the same.

FATAL hwi.HWIServer: HWI WAR file not found at /HADOOP/hive/lib/hive-hwi-0.8.1.war
Please suggest,

Regards
Yogesh Kumar
________________________________
From: [EMAIL PROTECTED] [[EMAIL PROTECTED]]
Sent: Tuesday, July 17, 2012 6:54 PM
To: [EMAIL PROTECTED]
Subject: Re: not able to access Hive web Interface

The problem is that it is probably looking for these files in HDFS instead of your local file system. As a workaround, try creating that path on HDFS and uploading these files there and see if it works. Also, try setting the fs.default.name<http://fs.default.name> property in conf-site.xml to point to your local filesystem instead of HDFS (file://.....).

PS: You can also directly do this from the hive command line itself.

hive> SET fs.default.name<http://fs.default.name>='file://`pwd`

But this would be temporary and limited to your current session.

Hope that helps.

On Tue, Jul 17, 2012 at 7:36 AM, <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi all :-),

Iam trying to access Hive Web Interface but it fails.

I have this changes in hive-site.xml

************************************************************************************************
<configuration>
   <property>
   <name>hive.hwi.listen.host</name>
   <value>0.0.0.0</value>
   <description>This is the host address the Hive Web Interface will listen on</description>
   </property>

   <property>
   <name>hive.hwi.listen.port</name>
   <value>9999</value>
   <description>This is the port the Hive Web Interface will listen on</description>
   </property>

   <property>
   <name>hive.hwi.war.file</name>
   <value>/HADOOP/hive/lib/hive-hwi-0.8.1.war</value> /* (Here is the hive directory) */
   <description>This is the WAR file with the jsp content for Hive Web Interface</description>
   </property>

</configuration>

***********************************************************************************************

And also export the ANT lib like.

export ANT_LIB=/Yogesh/ant-1.8.4/lib
export PATH=$PATH:$ANT_LIB
now when i do run command

hive --service hwi it results

12/07/17 18:03:02 INFO hwi.HWIServer: HWI is starting up
12/07/17 18:03:02 WARN conf.HiveConf: DEPRECATED: Ignoring hive-default.xml found on the CLASSPATH at /HADOOP/hive/conf/hive-default.xml
12/07/17 18:03:02 FATAL hwi.HWIServer: HWI WAR file not found at /HADOOP/hive/lib/hive-hwi-0.8.1.war
and if I go for

hive --service hwi --help it results

Usage ANT_LIB=XXXX hive --service hwi
Althought if I go to /HADOOP/hive/lib directory I found

1) hive-hwi-0.8.1.war
2) hive-hwi-0.8.1.jar

these files are present there.

what is Iam doing wrong :-( ?

Please help and Suggest

Greetings
Yogesh Kumar

Please do not print this email unless it is absolutely necessary.

The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments.

WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.

www.wipro.com<http://www.wipro.com>

--
Swarnim

Please do not print this email unless it is absolutely necessary.

The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments.

WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.

www.wipro.com

RE: not able to access Hive Web Interface

yogesh.kumar13@... 2012-07-18, 06:41

Hi all :-),

Iam trying to access Hive Web Interface but it fails.

I have this changes in hive-site.xml

************************************************************************************************
<configuration>
   <property>
   <name>hive.hwi.listen.host</name>
   <value>0.0.0.0</value>
   <description>This is the host address the Hive Web Interface will listen on</description>
   </property>

   <property>
   <name>hive.hwi.listen.port</name>
   <value>9999</value>
   <description>This is the port the Hive Web Interface will listen on</description>
   </property>

   <property>
   <name>hive.hwi.war.file</name>
   <value>/HADOOP/hive/lib/hive-hwi-0.8.1.war</value> /* (Here is the hive directory) */
   <description>This is the WAR file with the jsp content for Hive Web Interface</description>
   </property>

</configuration>

***********************************************************************************************

And also export the ANT lib like.

export ANT_LIB=/Yogesh/ant-1.8.4/lib
export PATH=$PATH:$ANT_LIB
now when i do run command

hive --service hwi it results

12/07/17 18:03:02 INFO hwi.HWIServer: HWI is starting up
12/07/17 18:03:02 WARN conf.HiveConf: DEPRECATED: Ignoring hive-default.xml found on the CLASSPATH at /HADOOP/hive/conf/hive-default.xml
12/07/17 18:03:02 FATAL hwi.HWIServer: HWI WAR file not found at /HADOOP/hive/lib/hive-hwi-0.8.1.war
and if I go for

hive --service hwi --help it results

Usage ANT_LIB=XXXX hive --service hwi
Althought if I go to /HADOOP/hive/lib directory I found

1) hive-hwi-0.8.1.war
2) hive-hwi-0.8.1.jar

these files are present there.

what is Iam doing wrong :-( ?

Please help and Suggest

Greetings
Yogesh Kumar

________________________________
From: Gesli, Nicole [[EMAIL PROTECTED]]
Sent: Wednesday, July 18, 2012 12:50 AM
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Re: DATA UPLOADTION

For the Hive query approach, check the string functions (https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-StringFunctions) or write your own (UDF), if needed. It depends on what you are trying to get. Example:

SELECT TRIM(SUBSTR(data, LOCATE(LOWER(data), ' this '), LOCATE(LOWER(data), ' that ')+5)) my_string
FROM log_table
WHERE LOWER(data) LIKE '%this%and%that%'
From: Bejoy KS <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>, "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Monday, July 16, 2012 11:39 PM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: DATA UPLOADTION

Hi Yogesh

You can connect reporting tools like tableau , micro strategy etc direcly with hive.

If you are looking for some static reports based on aggregate data. You can process the data in hive move the resultant data into some rdbms and use some common reporting tools over the same. I know quite a few projects following this model.
Regards
Bejoy KS

Sent from handheld, please excuse typos.
________________________________
From: <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Tue, 17 Jul 2012 06:33:43 +0000
To: <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>; <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
ReplyTo: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: RE: DATA UPLOADTION

Thanks Gesli and Bejoy,

I have created tables in hive and uploaded data into it. I can perform query on it, please suggest me how to generate reports from that tables.

Mr. Gesli,
If I create tables with single string column like ( create table Log_table( Data STRING); ) then how can perform condition based query over the data into Log_table ?
Thanks & Regards :-)
Yogesh Kumar

________________________________
From: Gesli, Nicole [[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Monday, July 16, 2012 11:30 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>; [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Cc: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: DATA UPLOADTION

If you are just trying to find certain text in the data files and you just want to do bulk process to create reports once a day or so, and prefer to use Hive: you can create a table with with single string column. You need to pre-process your data to replace the default column delimiter in your data. Or, you can define a column delimiter that your data does not have. That is to make sure that entire line data is assigned to the column but not cut in where the column delimiter is. If your query will be different for each file type (flat files, logs, xls,…) you can create different partitions for each file type. Dump your files into the table (or table partition) folder(s). Or you can create external table(s) if your data is already in HDFS. You can than do "like" (faster) or "rlike" search on the table.

-Nicole

From: Bejoy KS <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>, "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Monday, July 16, 2012 12:50 AM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Cc: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: DATA UPLOADTION

Hi Yogesh

If you are looking at some indexing and search kind of operation you can take a look at lucene.

Whether you are using hive or Hbase you cannot do any operation without having a table structure defined for the data. So you need to create tables for each dataset and then only you can go ahead and issue queries and generate report