Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: MRV2 job takes to long to start


Copy link to this message
-
Re: MRV2 job takes to long to start
What scheduler are you using?  What do you mean by "start"?  For the first
map task to start?

-Sandy
On Thu, Nov 28, 2013 at 6:07 AM, Juan Martin Pampliega <[EMAIL PROTECTED]
> wrote:

> Hi,
>
> I have a map-reduce job that was developed for MRV1 and is now being run
> daily with no modifications in a hadoop 2.2 cluster with MRV2.
>
> For the first week at least the job worked as expected but now some days
> the job takes a long time to start (like 30-50 minutes). The job starts a
> large number of mappers (around 525) and it usually just took a couple of
> minutes for it to start. Also, there are no other jobs running at the same
> time.
>
> Any ideas what might be causing this?
>
> Thanks,
> Juan.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB