Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # dev >> Re: Running Hive unit tests on a fully-distributed cluster

Copy link to this message
Re: Running Hive unit tests on a fully-distributed cluster
Thanks Mark for looking into this. Getting our test harness to run on
fully-distributed hadoop cluster will be immensely valuable. There are few
things to consider.
https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to run
tests on fully distributed cluster. But it doesnt yet support running .q
files. I believe it comes with its own smaller set of tests.
Other thing to consider is TestMinmrCliDriver which runs .q tests in
distributed mode but only a handful of those. May be we can provide an
option to have that run all tests.

On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]>wrote:

> Hi all,
> Is there a way to run Hive unit tests against a fully-distributed Hadoop
> cluster? I poked around the code and was only able to find two modes -
> local mode and miniMR. Is there a property or something similar that I can
> set to do so?
>  I have been contributing recently to Apache Bigtop<
> http://bigtop.apache.org>,
> a project responsible for performing packaging and interoperability testing
> of various projects in the Hadoop ecosystem, including Apache Hive. I would
> really like Bigtop to leverage Hive's unit test framework but the catch is
> that Bigtop needs to run tests in non-local mode. For now, I have created a
> JIRA (HIVE-4362) for this but if such a way already exists please let me
> know.
> Mark