Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> how to design the mapper and reducer for the below problem


+
parnab kumar 2013-06-14, 04:41
+
Azuryy Yu 2013-06-14, 08:37
+
Harsh J 2013-06-14, 09:39
+
John Lilley 2013-06-16, 19:02
Copy link to this message
-
RE: how to design the mapper and reducer for the below problem
Sorry this is the link I meant: http://hortonworks.com/blog/transitive-closure-in-apache-pig/
john

From: John Lilley [mailto:[EMAIL PROTECTED]]
Sent: Sunday, June 16, 2013 1:02 PM
To: [EMAIL PROTECTED]
Subject: RE: how to design the mapper and reducer for the below problem

I don't think can be done in a single map/reduce pass.
Here the author discusses an implementation in PIG: http://techblug.wordpress.com/2011/08/07/transitive-closure-in-pig/
john

From: parnab kumar [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 13, 2013 10:42 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: how to design the mapper and reducer for the below problem

Consider a following input file of format :
input File :
1 2
2 3
3 4
6 7
7 9
10 11

The output Should be as follows :

1 2 3 4
6 7 9
10 11
+
parnab kumar 2013-06-14, 14:06
+
Sanjay Subramanian 2013-06-14, 16:15
+
John Lilley 2013-06-16, 19:25
+
John Lilley 2013-06-16, 19:40
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB