Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Bigtop >> mail # dev >> Running Hive unit tests on a fully-distributed cluster


Copy link to this message
-
Re: Running Hive unit tests on a fully-distributed cluster
Thanks, Ashutosh! I will take a look.

On Mon, Apr 15, 2013 at 5:55 PM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:

> Thanks Mark for looking into this. Getting our test harness to run on
> fully-distributed hadoop cluster will be immensely valuable. There are few
> things to consider.
> https://issues.apache.org/jira/browse/HIVE-2670 provides a framework to
> run
> tests on fully distributed cluster. But it doesnt yet support running .q
> files. I believe it comes with its own smaller set of tests.
> Other thing to consider is TestMinmrCliDriver which runs .q tests in
> distributed mode but only a handful of those. May be we can provide an
> option to have that run all tests.
>
> Ashutosh
>
>
> On Mon, Apr 15, 2013 at 5:26 PM, Mark Grover <[EMAIL PROTECTED]
> >wrote:
>
> > Hi all,
> > Is there a way to run Hive unit tests against a fully-distributed Hadoop
> > cluster? I poked around the code and was only able to find two modes -
> > local mode and miniMR. Is there a property or something similar that I
> can
> > set to do so?
> >
> >  I have been contributing recently to Apache Bigtop<
> > http://bigtop.apache.org>,
> > a project responsible for performing packaging and interoperability
> testing
> > of various projects in the Hadoop ecosystem, including Apache Hive. I
> would
> > really like Bigtop to leverage Hive's unit test framework but the catch
> is
> > that Bigtop needs to run tests in non-local mode. For now, I have
> created a
> > JIRA (HIVE-4362) for this but if such a way already exists please let me
> > know.
> >
> > Mark
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB