Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: issue about running example job use custom mapreduce var


Copy link to this message
-
Re: issue about running example job use custom mapreduce var
ch huang 2013-12-11, 01:04
yes,you are right ,thanks

On Wed, Dec 11, 2013 at 7:16 AM, Adam Kawa <[EMAIL PROTECTED]> wrote:

>  Accidentally, I clicked "Sent" by a mistake. Plase try:
>
> hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
> terasort *-Dmapreduce.job.reduces=34* /alex/terasort/1G-input
> /alex/terasort/1G-output
>
>
> 2013/12/11 Adam Kawa <[EMAIL PROTECTED]>
>
>> Please try
>>
>>
>>
>> 2013/12/10 ch huang <[EMAIL PROTECTED]>
>>
>>> hi,maillist:
>>>                 i try assign reduce number in commandline but seems not
>>> useful,i run tera sort like this
>>>
>>> # hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
>>> terasort /alex/terasort/1G-input /alex/terasort/1G-output
>>> -Dmapreduce.job.reduces=34
>>>
>>> so default mapred-site.xml assign reducer number is 16,i try run it with
>>> 34 reducers,but the job run still as 16 reducers number,why?
>>>
>>> here is some output:
>>>
>>>         Job Counters
>>>                 Launched map tasks=1
>>>                 Launched reduce tasks=16
>>>                 Rack-local map tasks=1
>>>                 Total time spent by all maps in occupied slots (ms)=2318
>>>                 Total time spent by all reduces in occupied slots
>>> (ms)=99714
>>>
>>
>>
>