Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Bigtop >> mail # user >> Bigtop for Goraci

Copy link to this message
Re: Bigtop for Goraci
Hi Cos,

On Friday, June 7, 2013, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:
> very interesting stuff, indeed. I am a little bit confused though: when
> are saying "does anyone have an idea about how we can get this working in
> tandem" what parts needs to be coupled here? The suite and DB

The suite and DB implementation... you got it. The difference in running
the suite across different datastores is as follows

1. Add some trivial configuration to a gora.properties file specifying
which datastore you wish to use
2. generate a trivial xml mapping file which maps an avro JSON schema to
persistent beans. (we are in the process of automating this)
3. Run a mvn profile to download the required dependencies for whichever
datastore the test has to run against
4. execute commands from a bash script which run the test(s).
5. Aggregate the results from the MR jobs.

> Or is it something else? Appreciate more info.

Well yeah there kinda is 'something else' we need to provision clusters of
machines kitted out with the specific databases up and running prior to the
execution of my (most likely) rather simplified step-by-step above ;)

I don't imagine automating  the step-by-step to be much of a problem, but I
don't know where in gods name we could setUp() clusters of machines for
each datastore in a uniform manner.
Thanks so much for your input, it is really really valuable.