Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Re: Hive join does not execute


+
shashwat shriparv 2012-05-10, 17:14
Copy link to this message
-
Re: Hive join does not execute
Thanx a lot. It worked!

On Thu, May 10, 2012 at 1:14 PM, shashwat shriparv <
[EMAIL PROTECTED]> wrote:

>
> Some suggestion :
>
>
>
>
> 1. Chown of the hive folder
> 2. change permission of hive folder to 755
> 3. Set this to hive-site.xml
>
>
> <property>
>     <name>hive.exec.scratchdir</name>
>     <value>/home/yourusername/mydir</value>
>     <description>Scratch space for Hive jobs</description>
>   </property>
>
>
>
> 3. put
>
>
> hadoop-0.20-core.jar
> hive/lib/hive-exec-0.7.1.jar
> hive/lib/hive-jdbc-0.7.1.jar
> hive/lib/hive-metastore-0.7.1.jar
> hive/lib/hive-service-0.7.1.jar
> hive/lib/libfb303.jar
> lib/commons-logging-1.0.4.jar
> slf4j-api-1.6.1.jar
> slf4j-log4j12-1.6.1.jar
>
> these file to hive lib folder
>
>
>
> Define external jar in hive site xml file as follows :
>
>
>
> IN hive-env.sh change following:
>
>
> # Set HADOOP_HOME to point to a specific hadoop install directory
>
> #here instead of path what i have given you give your own path where hadoop #is there
> export HADOOP_HOME=/home/shashwat/Hadoop/hadoop-0.20.205
>
> # Hive Configuration Directory can be controlled by:
>
> #here you specify the conf directory path of hive
> export HIVE_CONF_DIR=/home/shashwat/Hadoop/hive-0.7.1/conf
>
> #Folder containing extra ibraries required for hive compilation/execution
>
> #can be controlled by:
>
> #here you specify the lib file directory, here you can specify the lib
>
> #directory of hadoop lib folder too like follows:
> export HIVE_AUX_JARS_PATH=/home/shashwat/Hadoop/hive-0.7.1/lib:/home/shashwat/Hadoop/hadoop-0.20.205/lib:/home/shashwat/Hadoop/hbase/lib
>
>
>
>
>
>
>
> and also in hive-site.xml
>
>
>
>
>
>   <property>
>     <name>hive.aux.jars.path</name>
>  <value>file:///home/shashwat/Hadoop/hive-0.7.1/lib/hive-hbase-handler-0.7.1.jar,file:///home/shashwat/Hadoop/hive-0.7.1/lib/hbase-0.90.4.jar,file:///home/shashwat/Hadoop/hive-0.7.1/lib/zookeeper-3.3.1.jar</value>
>   </property>
>
>
> by default if you have just downloaded the hive there will not be hive-site.xml or hive-env.sh by default in conf dir there will be hive-site.xml.template and same for the hive-env.sh so make a backupe of both and rename hive-site.xml.template to hive-site.xml and hive-env.sh.template to hive-env.sh and make the changes what i suggested...
>
>
>
>
>
> Note : when ever you download something and extract in linux dont forget to change owner and change mode using chown and chmod for the folder recursively
>
>
>
> Hope this will help you..
>
> Cheer
>
>
>
> ∞
>
> Shashwat Shriparv
>
>
>
>
>
>
>
>
>
>
>
> On Thu, May 10, 2012 at 9:59 PM, Mahsa Mofidpoor <[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> When I want to join two tables, I receive the following error:
>>
>> 12/05/10 12:03:31 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
>> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
>> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
>> files.
>> Execution log at:
>> /tmp/umroot/umroot_20120510120303_4d0145bb-27fa-4d4a-8cbc-95d8353fccaf.log
>> ENOENT: No such file or directory
>> at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
>>  at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:692)
>> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:647)
>>  at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>>  at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>> at
>> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>>  at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
>> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
>>  at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>  at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB