Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # dev >> Re: Running Hive unit tests on a fully-distributed cluster


Copy link to this message
-
Re: Running Hive unit tests on a fully-distributed cluster
Thanks Mark for looking into this. Getting our test harness to run on
fully-distributed hadoop cluster will be immensely valuable. There are few
things to consider.
https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to run
tests on fully distributed cluster. But it doesnt yet support running .q
files. I believe it comes with its own smaller set of tests.
Other thing to consider is TestMinmrCliDriver which runs .q tests in
distributed mode but only a handful of those. May be we can provide an
option to have that run all tests.

Ashutosh
On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]>wrote:

> Hi all,
> Is there a way to run Hive unit tests against a fully-distributed Hadoop
> cluster? I poked around the code and was only able to find two modes -
> local mode and miniMR. Is there a property or something similar that I can
> set to do so?
>
>  I have been contributing recently to Apache Bigtop<
> http://bigtop.apache.org>,
> a project responsible for performing packaging and interoperability testing
> of various projects in the Hadoop ecosystem, including Apache Hive. I would
> really like Bigtop to leverage Hive's unit test framework but the catch is
> that Bigtop needs to run tests in non-local mode. For now, I have created a
> JIRA (HIVE-4362) for this but if such a way already exists please let me
> know.
>
> Mark
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB