-Re: Running Hive unit tests on a fully-distributed cluster
Mark Grover 2013-04-16, 04:23
Thanks, Ashutosh! I will take a look.
On Mon, Apr 15, 2013 at 5:55 PM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:
> Thanks Mark for looking into this. Getting our test harness to run on
> fully-distributed hadoop cluster will be immensely valuable. There are few
> things to consider.
> https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to
> tests on fully distributed cluster. But it doesnt yet support running .q
> files. I believe it comes with its own smaller set of tests.
> Other thing to consider is TestMinmrCliDriver which runs .q tests in
> distributed mode but only a handful of those. May be we can provide an
> option to have that run all tests.
> On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]
> > Hi all,
> > Is there a way to run Hive unit tests against a fully-distributed Hadoop
> > cluster? I poked around the code and was only able to find two modes -
> > local mode and miniMR. Is there a property or something similar that I
> > set to do so?
> > I have been contributing recently to Apache Bigtop<
> > http://bigtop.apache.org>,
> > a project responsible for performing packaging and interoperability
> > of various projects in the Hadoop ecosystem, including Apache Hive. I
> > really like Bigtop to leverage Hive's unit test framework but the catch
> > that Bigtop needs to run tests in non-local mode. For now, I have
> created a
> > JIRA (HIVE-4362) for this but if such a way already exists please let me
> > know.
> > Mark