Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Bigtop, mail # dev - Running Hive unit tests on a fully-distributed cluster


+
Mark Grover 2013-04-16, 00:26
Copy link to this message
-
Re: Running Hive unit tests on a fully-distributed cluster
Mark Grover 2013-04-16, 04:23
Thanks, Ashutosh! I will take a look.

On Mon, Apr 15, 2013 at 5:55 PM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:

> Thanks Mark for looking into this. Getting our test harness to run on
> fully-distributed hadoop cluster will be immensely valuable. There are few
> things to consider.
> https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to
> run
> tests on fully distributed cluster. But it doesnt yet support running .q
> files. I believe it comes with its own smaller set of tests.
> Other thing to consider is TestMinmrCliDriver which runs .q tests in
> distributed mode but only a handful of those. May be we can provide an
> option to have that run all tests.
>
> Ashutosh
>
>
> On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]
> >wrote:
>
> > Hi all,
> > Is there a way to run Hive unit tests against a fully-distributed Hadoop
> > cluster? I poked around the code and was only able to find two modes -
> > local mode and miniMR. Is there a property or something similar that I
> can
> > set to do so?
> >
> >  I have been contributing recently to Apache Bigtop<
> > http://bigtop.apache.org>,
> > a project responsible for performing packaging and interoperability
> testing
> > of various projects in the Hadoop ecosystem, including Apache Hive. I
> would
> > really like Bigtop to leverage Hive's unit test framework but the catch
> is
> > that Bigtop needs to run tests in non-local mode. For now, I have
> created a
> > JIRA (HIVE-4362) for this but if such a way already exists please let me
> > know.
> >
> > Mark
> >
>