Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> reducer not starting


Copy link to this message
-
reducer not starting
I am not sure whats happening, but I wrote a simple mapper and reducer
script.

And I am testing it against a small dataset (like few lines long).

For some reason reducer is just not starting.. and mapper is executing
again and again?

    12/11/20 09:21:18 INFO streaming.StreamJob:  map 0%  reduce 0%

    12/11/20 09:22:05 INFO streaming.StreamJob:  map 50%  reduce 0%

    12/11/20 09:22:10 INFO streaming.StreamJob:  map 100%  reduce 0%

    12/11/20 09:32:05 INFO streaming.StreamJob:  map 50%  reduce 0%

    12/11/20 09:32:11 INFO streaming.StreamJob:  map 0%  reduce 0%

    12/11/20 09:32:20 INFO streaming.StreamJob:  map 50%  reduce 0%

    12/11/20 09:32:31 INFO streaming.StreamJob:  map 100%  reduce 0%

    12/11/20 09:42:20 INFO streaming.StreamJob:  map 50%  reduce 0%

    12/11/20 09:42:31 INFO streaming.StreamJob:  map 0%  reduce 0%

    12/11/20 09:42:32 INFO streaming.StreamJob:  map 50%  reduce 0%

    12/11/20 09:42:50 INFO streaming.StreamJob:  map 100%  reduce 0%

Let me know if you want the code also.

Any clues of where I am going wrong?

Thanks
+
Harsh J 2012-11-20, 17:16
+
praveenesh kumar 2012-11-21, 12:00
+
Jean-Marc Spaggiari 2012-11-21, 12:45
+
jamal sasha 2012-11-21, 14:36
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB