Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Observer/Observable MapReduce


Copy link to this message
-
Re: Observer/Observable MapReduce
Andrey Stepachev 2011-03-25, 21:53
Look at http://yahoo.github.com/oozie/. May be it will helps you.

2011/3/25 Vishal Kapoor <[EMAIL PROTECTED]>

> Can someone give me a direction on how to start a map reduce based on
> an outcome of another map reduce? ( nothing common between them apart
> from the first decides about the scope of the second.
>
> I might also want to set the scope of my second map reduce
> (from/after) my first map reduce(scope as in scan(start,stop)
>
> typically data comes in a few tables for us and we start crunching it
> and then adding some more data to man tables like info etc to get rid
> of table joins.
>
> a light weight framework will do better than a typical workflow management
> tool.
>
> thanks,
> Vishal Kapoor
>