Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> how to design the mapper and reducer for the below problem


+
parnab kumar 2013-06-14, 04:41
+
Azuryy Yu 2013-06-14, 08:37
+
Harsh J 2013-06-14, 09:39
+
John Lilley 2013-06-16, 19:02
Copy link to this message
-
RE: how to design the mapper and reducer for the below problem
Sorry this is the link I meant: http://hortonworks.com/blog/transitive-closure-in-apache-pig/
john

From: John Lilley [mailto:[EMAIL PROTECTED]]
Sent: Sunday, June 16, 2013 1:02 PM
To: [EMAIL PROTECTED]
Subject: RE: how to design the mapper and reducer for the below problem

I don't think can be done in a single map/reduce pass.
Here the author discusses an implementation in PIG: http://techblug.wordpress.com/2011/08/07/transitive-closure-in-pig/
john

From: parnab kumar [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 13, 2013 10:42 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: how to design the mapper and reducer for the below problem

Consider a following input file of format :
input File :
1 2
2 3
3 4
6 7
7 9
10 11

The output Should be as follows :

1 2 3 4
6 7 9
10 11
+
parnab kumar 2013-06-14, 14:06
+
Sanjay Subramanian 2013-06-14, 16:15
+
John Lilley 2013-06-16, 19:25
+
John Lilley 2013-06-16, 19:40