Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> reducer not starting


+
jamal sasha 2012-11-20, 16:52
Copy link to this message
-
Re: reducer not starting
Your mappers are failing (possibly a user-side error or an
environmental one) and are being reattempted by the framework (default
behavior, attempts 4 times to avoid transient failure scenario).

Visit your job's logs in the JobTracker web UI, to find more
information on why your tasks fail.

On Tue, Nov 20, 2012 at 10:22 PM, jamal sasha <[EMAIL PROTECTED]> wrote:
>
>
>
> I am not sure whats happening, but I wrote a simple mapper and reducer
> script.
>
>
>
> And I am testing it against a small dataset (like few lines long).
>
>
>
> For some reason reducer is just not starting.. and mapper is executing again
> and again?
>
>
>
>     12/11/20 09:21:18 INFO streaming.StreamJob:  map 0%  reduce 0%
>
>     12/11/20 09:22:05 INFO streaming.StreamJob:  map 50%  reduce 0%
>
>     12/11/20 09:22:10 INFO streaming.StreamJob:  map 100%  reduce 0%
>
>     12/11/20 09:32:05 INFO streaming.StreamJob:  map 50%  reduce 0%
>
>     12/11/20 09:32:11 INFO streaming.StreamJob:  map 0%  reduce 0%
>
>     12/11/20 09:32:20 INFO streaming.StreamJob:  map 50%  reduce 0%
>
>     12/11/20 09:32:31 INFO streaming.StreamJob:  map 100%  reduce 0%
>
>     12/11/20 09:42:20 INFO streaming.StreamJob:  map 50%  reduce 0%
>
>     12/11/20 09:42:31 INFO streaming.StreamJob:  map 0%  reduce 0%
>
>     12/11/20 09:42:32 INFO streaming.StreamJob:  map 50%  reduce 0%
>
>     12/11/20 09:42:50 INFO streaming.StreamJob:  map 100%  reduce 0%
>
>
>
>
>
> Let me know if you want the code also.
>
> Any clues of where I am going wrong?
>
> Thanks
>
>
>
>
>
>

--
Harsh J
+
praveenesh kumar 2012-11-21, 12:00
+
Jean-Marc Spaggiari 2012-11-21, 12:45
+
jamal sasha 2012-11-21, 14:36
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB