Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: issue about running example job use custom mapreduce var


Copy link to this message
-
Re: issue about running example job use custom mapreduce var
Adam Kawa 2013-12-10, 23:16
Accidentally, I clicked "Sent" by a mistake. Plase try:

hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort
*-Dmapreduce.job.reduces=34* /alex/terasort/1G-input
/alex/terasort/1G-output
2013/12/11 Adam Kawa <[EMAIL PROTECTED]>

> Please try
>
>
>
> 2013/12/10 ch huang <[EMAIL PROTECTED]>
>
>> hi,maillist:
>>                 i try assign reduce number in commandline but seems not
>> useful,i run tera sort like this
>>
>> # hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
>> terasort /alex/terasort/1G-input /alex/terasort/1G-output
>> -Dmapreduce.job.reduces=34
>>
>> so default mapred-site.xml assign reducer number is 16,i try run it with
>> 34 reducers,but the job run still as 16 reducers number,why?
>>
>> here is some output:
>>
>>         Job Counters
>>                 Launched map tasks=1
>>                 Launched reduce tasks=16
>>                 Rack-local map tasks=1
>>                 Total time spent by all maps in occupied slots (ms)=2318
>>                 Total time spent by all reduces in occupied slots
>> (ms)=99714
>>
>
>