-Re: Running Hive unit tests on a fully-distributed cluster
Ashutosh Chauhan 2013-04-16, 00:55
Thanks Mark for looking into this. Getting our test harness to run on
fully-distributed hadoop cluster will be immensely valuable. There are few
things to consider.
https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to run
tests on fully distributed cluster. But it doesnt yet support running .q
files. I believe it comes with its own smaller set of tests.
Other thing to consider is TestMinmrCliDriver which runs .q tests in
distributed mode but only a handful of those. May be we can provide an
option to have that run all tests.
On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]>wrote:
> Hi all,
> Is there a way to run Hive unit tests against a fully-distributed Hadoop
> cluster? I poked around the code and was only able to find two modes -
> local mode and miniMR. Is there a property or something similar that I can
> set to do so?
> I have been contributing recently to Apache Bigtop<
> a project responsible for performing packaging and interoperability testing
> of various projects in the Hadoop ecosystem, including Apache Hive. I would
> really like Bigtop to leverage Hive's unit test framework but the catch is
> that Bigtop needs to run tests in non-local mode. For now, I have created a
> JIRA (HIVE-4362) for this but if such a way already exists please let me