Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive unit test errors


Copy link to this message
-
Re: Hive unit test errors
This seems to work for me on trunk. This should work in 0.11 as well,
given that the feature it is complaining about was introduced in
HIVE-4139, which was committed in hive-0.11.

Could you please check your /hive/build/shims/hive-shims-0.11.0.jar
(should be the same as
/Users/echu/.ivy2/local/org.apache.hive/hive-shims/0.11.0/jars/hive-shims.jar
) and run jar tf on it to see if it has the following definitions:

org/apache/hadoop/hive/shims/Hadoop20SShims$MiniMrShim.class
org/apache/hadoop/hive/shims/Hadoop20Shims$MiniMrShim.class
org/apache/hadoop/hive/shims/Hadoop23Shims$MiniMrShim.class
org/apache/hadoop/hive/shims/HadoopShims$MiniMrShim.class

And failing that, if your codebase has MiniMrShim defined in
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java ?

On Tue, Sep 3, 2013 at 2:39 PM, Eric Chu <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I'm trying to run unit tests on Hive 11 (with a few patches such as 4619,
> 4003, 4403, 4900, 3632, 4942) and encountering compile-test errors. I got
> the same thing when I ran on Trunk or just the 11 branch. Is there something
> I'm missing? Note that I could build and run Hive w/out problems.
>
> Commands:
>     export ANT_OPTS=-XX:MaxPermSize=512M
>     ant very-clean package test -logfile ant.log
>
> Error (Attached is full log):
> compile-test:
>      [echo] Project: ql
>     [javac] Compiling 92 source files to /hive/build/ql/test/classes
>     [javac] /hive/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java:118:
> cannot find symbol
>     [javac] symbol  : class MiniMrShim
>     [javac] location: interface org.apache.hadoop.hive.shims.HadoopShims
>     [javac]   private HadoopShims.MiniMrShim mr = null;
>     [javac]                      ^
>     [javac] /hive/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java:284:
> cannot find symbol
>     [javac] symbol  : method
> getMiniMrCluster(org.apache.hadoop.hive.conf.HiveConf,int,java.lang.String,int)
>     [javac] location: interface org.apache.hadoop.hive.shims.HadoopShims
>     [javac]       mr = ShimLoader.getHadoopShims().getMiniMrCluster(conf, 4,
> getHdfsUriString(fs.getUri().toString()), 1);
>     [javac]                                       ^
>     [javac]
> /hive/ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java:57:
> cannot find symbol
>     [javac] symbol  : variable decimalTypeInfo
>     [javac] location: class
> org.apache.hadoop.hive.serde2.typeinfo.TypeInfoFactory
>     [javac]     implicit(TypeInfoFactory.intTypeInfo,
> TypeInfoFactory.decimalTypeInfo, true);
>
> ....
>
> Thanks,
>
> Eric
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB