Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Mappers only job, output sorted?


Copy link to this message
-
Mappers only job, output sorted?
i have mappers only job - number of reducers set to 0. Its hadoop 0.22
and output from job is this:

2012-03-24 18:24:22,117 WARN org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
2012-03-24 18:24:22,734 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=MAP, sessionId2012-03-24 18:24:37,748 WARN org.apache.hadoop.conf.Configuration:
user.name is deprecated. Instead, use mapreduce.job.user.name
2012-03-24 18:24:38,718 INFO org.apache.hadoop.mapred.Task:  Using
ResourceCalculatorPlugin : null
2012-03-24 18:24:41,447 INFO org.apache.hadoop.mapred.Task:
Task:attempt_201201250916_0074_m_000036_0 is done. And is in the process
of commiting
2012-03-24 18:24:42,472 INFO org.apache.hadoop.mapred.Task: Task
attempt_201201250916_0074_m_000036_0 is allowed to commit now
2012-03-24 18:24:42,478 INFO
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output
of task 'attempt_201201250916_0074_m_000036_0' to /cznewgen/db-fixed
2012-03-24 18:24:42,479 INFO org.apache.hadoop.mapred.Task: Task
'attempt_201201250916_0074_m_000036_0' done.

is this job still sorting keys in mapper output? Because task status for
mapper says "map > sort". I do not need output sorted.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB