Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Dynamically determining number of reducers


Copy link to this message
-
Re: Dynamically determining number of reducers
JobClient.getClusterStatus().getMaxReduceTasks().

On Apr 23, 2010, at 10:34 AM, Farhan Husain wrote:

> I actually wanted to mean number of tasktrackers. I want to set the  
> number
> of reducers equal to the number of tasktrackers present in the  
> cluster and I
> want to determine the number of tasktrackers dynamically.
>
> Thanks,
> Farhan
>
> On Fri, Apr 23, 2010 at 12:03 PM, Farhan Husain
> <[EMAIL PROTECTED]>wrote:
>
>> Hello,
>>
>> Is there any way to determine the number of reducers present in the  
>> cluster
>> dynamically? I need to determine it when the job parameters are set  
>> up.
>>
>> Thanks,
>> Farhan
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB