-Re: Hive 0.11 with Cloudera CHD4.3 MR v1
Srinivas Surasani 2013-07-21, 06:15
Can you share your job logs ?
On Mon, Jul 15, 2013 at 6:32 PM, Jim Colestock <[EMAIL PROTECTED]>wrote:
> Hello All,
> Has anyone been successful at running hive 0.11 with Cloudera CDH 4.3?
> I've been able to get hive to connect to my metadb (which is in Postgres).
> Verified by doing a show tables.. I can run explain and describes on
> tables, but when I try to run anything that fires off an M/R job, I get the
> following error:
> hive>select count(*) from tableA;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks determined at compile time: 1
> In order to change the average load for a reducer (in bytes):
> set hive.exec.reducers.bytes.per.reducer=<number>
> In order to limit the maximum number of reducers:
> set hive.exec.reducers.max=<number>
> In order to set a constant number of reducers:
> set mapred.reduce.tasks=<number>
> Starting Job = job_201307112247_13816, Tracking URL > http://master:50030/jobdetails.jsp?jobid=job_201307112247_13816
> Kill Command = /usr/lib/hadoop/bin/hadoop job -kill job_201307112247_13816
> Hadoop job information for Stage-1: number of mappers: 1; number of
> reducers: 1
> 2013-07-12 02:11:42,829 Stage-1 map = 0%, reduce = 0%
> 2013-07-12 02:12:08,173 Stage-1 map = 100%, reduce = 100%
> Ended Job = job_201307112247_13816 with errors
> Error during job, obtaining debugging information...
> Job Tracking URL:
> Examining task ID: task_201307112247_13816_m_000002 (and more) from job
> Exception in thread "Thread-19" java.lang.NoClassDefFoundError:
> at java.lang.Thread.run(Thread.java:619)
> Caused by: java.lang.ClassNotFoundException:
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
> ... 4 more
> FAILED: Execution Error, return code 2 from
> MapReduce Jobs Launched:
> Job 0: Map: 1 Reduce: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> Total MapReduce CPU Time Spent: 0 msec
> I'm using my configs from hive 0.10, which works with no issues and this
> was pretty much a drop in replacement on the machine that hadoop 0.10 was
> running on..
> I've done a bunch of googling around and have found a bunch of other folks
> that have have had the same issue, but no solid answers..
> Thanks in advance for any help..