Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - Hive unit test errors


+
Eric Chu 2013-09-03, 21:39
Copy link to this message
-
Re: Hive unit test errors
Sushanth Sowmyan 2013-09-04, 18:00
This seems to work for me on trunk. This should work in 0.11 as well,
given that the feature it is complaining about was introduced in
HIVE-4139, which was committed in hive-0.11.

Could you please check your /hive/build/shims/hive-shims-0.11.0.jar
(should be the same as
/Users/echu/.ivy2/local/org.apache.hive/hive-shims/0.11.0/jars/hive-shims.jar
) and run jar tf on it to see if it has the following definitions:

org/apache/hadoop/hive/shims/Hadoop20SShims$MiniMrShim.class
org/apache/hadoop/hive/shims/Hadoop20Shims$MiniMrShim.class
org/apache/hadoop/hive/shims/Hadoop23Shims$MiniMrShim.class
org/apache/hadoop/hive/shims/HadoopShims$MiniMrShim.class

And failing that, if your codebase has MiniMrShim defined in
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java ?

On Tue, Sep 3, 2013 at 2:39 PM, Eric Chu <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I'm trying to run unit tests on Hive 11 (with a few patches such as 4619,
> 4003, 4403, 4900, 3632, 4942) and encountering compile-test errors. I got
> the same thing when I ran on Trunk or just the 11 branch. Is there something
> I'm missing? Note that I could build and run Hive w/out problems.
>
> Commands:
>     export ANT_OPTS=-XX:MaxPermSize=512M
>     ant very-clean package test -logfile ant.log
>
> Error (Attached is full log):
> compile-test:
>      [echo] Project: ql
>     [javac] Compiling 92 source files to /hive/build/ql/test/classes
>     [javac] /hive/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java:118:
> cannot find symbol
>     [javac] symbol  : class MiniMrShim
>     [javac] location: interface org.apache.hadoop.hive.shims.HadoopShims
>     [javac]   private HadoopShims.MiniMrShim mr = null;
>     [javac]                      ^
>     [javac] /hive/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java:284:
> cannot find symbol
>     [javac] symbol  : method
> getMiniMrCluster(org.apache.hadoop.hive.conf.HiveConf,int,java.lang.String,int)
>     [javac] location: interface org.apache.hadoop.hive.shims.HadoopShims
>     [javac]       mr = ShimLoader.getHadoopShims().getMiniMrCluster(conf, 4,
> getHdfsUriString(fs.getUri().toString()), 1);
>     [javac]                                       ^
>     [javac]
> /hive/ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java:57:
> cannot find symbol
>     [javac] symbol  : variable decimalTypeInfo
>     [javac] location: class
> org.apache.hadoop.hive.serde2.typeinfo.TypeInfoFactory
>     [javac]     implicit(TypeInfoFactory.intTypeInfo,
> TypeInfoFactory.decimalTypeInfo, true);
>
> ....
>
> Thanks,
>
> Eric
>
+
Eric Chu 2013-09-06, 09:27
+
Eric Chu 2013-09-06, 23:12
+
Sushanth Sowmyan 2013-09-09, 21:35
+
Edward Capriolo 2013-09-09, 21:49
+
shouvanik.haldar@... 2013-09-09, 21:53