Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Keeping intermediate results


Copy link to this message
-
Keeping intermediate results
Yaron Gonen 2011-11-06, 16:21
Hi,
Suppose I have chained M/R jobs that traverse a graph and look for nodes
with a specific value. Every time a Map encounters that value, I'd like to
keep that node in the final result.
I can of course save it with a special key and use a condition in the
Reducer, but is there a more formal or elegant way?

thanks,
Yaron