Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Increasing number of Reducers


+
Masoud 2012-03-20, 08:52
Copy link to this message
-
Re: Increasing number of Reducers
bejoy.hadoop@... 2012-03-20, 10:02
Hi Mausoud
Set -D mapred.reduce.tasks=n; ie  to any higher value.
Sent from BlackBerry® on Airtel

-----Original Message-----
From: Masoud <[EMAIL PROTECTED]>
Date: Tue, 20 Mar 2012 17:52:58
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Increasing number of Reducers

Hi all,

we have a cluster with 32 machines and running C# version of wordcount
program on it.
Map phase is done by different machines but Reduce is only done by one
machine. Our data is around 7G text data and by using one machine for
Reduce phase this job is doing so slowly.
Is there any way to increase number of reducers?

Thanks
Masoud
+
Masoud 2012-03-20, 10:49
+
bejoy.hadoop@... 2012-03-20, 11:05