Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> number of map and reduce task does not change in M/R program


Copy link to this message
-
Re: number of map and reduce task does not change in M/R program
Try running the job locally on a small set of the data and see if it takes
too long. If so, you map code might have some performance issues
On Sat, Oct 19, 2013 at 9:08 AM, Anseh Danesh <[EMAIL PROTECTED]>wrote:

> Hi all.. I have a question.. I have a mapreduce program that get input
> from cassandra. my input is a little big, about 100000000 data. my problem
> is that my program takes too long to process, but I think mapreduce is good
> and fast for large volume of data. so I think maybe I have problems in
> number of map and reduce tasks.. I set the number of map and reduce asks
> with JobConf, with Job, and also in conf/mapred-site.xml, but I don't see
> any changes.. in my logs at first there is map 0% reduce 0% and after about
> 2 hours working it shows map 1% reduce 0%..!! what should I do? please Help
> me I really get confused...
>