Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - how to design the mapper and reducer for the below problem


Copy link to this message
-
RE: how to design the mapper and reducer for the below problem
John Lilley 2013-06-16, 19:03
Sorry this is the link I meant: http://hortonworks.com/blog/transitive-closure-in-apache-pig/
john

From: John Lilley [mailto:[EMAIL PROTECTED]]
Sent: Sunday, June 16, 2013 1:02 PM
To: [EMAIL PROTECTED]
Subject: RE: how to design the mapper and reducer for the below problem

I don't think can be done in a single map/reduce pass.
Here the author discusses an implementation in PIG: http://techblug.wordpress.com/2011/08/07/transitive-closure-in-pig/
john

From: parnab kumar [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 13, 2013 10:42 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: how to design the mapper and reducer for the below problem

Consider a following input file of format :
input File :
1 2
2 3
3 4
6 7
7 9
10 11

The output Should be as follows :

1 2 3 4
6 7 9
10 11