Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Observer/Observable MapReduce

Copy link to this message
Re: Observer/Observable MapReduce
Look at http://yahoo.github.com/oozie/. May be it will helps you.

2011/3/25 Vishal Kapoor <[EMAIL PROTECTED]>

> Can someone give me a direction on how to start a map reduce based on
> an outcome of another map reduce? ( nothing common between them apart
> from the first decides about the scope of the second.
> I might also want to set the scope of my second map reduce
> (from/after) my first map reduce(scope as in scan(start,stop)
> typically data comes in a few tables for us and we start crunching it
> and then adding some more data to man tables like info etc to get rid
> of table joins.
> a light weight framework will do better than a typical workflow management
> tool.
> thanks,
> Vishal Kapoor