Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Memory Manager in Hadoop MR


Copy link to this message
-
Re: Memory Manager in Hadoop MR
For 1, TMMT uses ProcessTree to check for task that is running beyond
memory-limits and kills it.

On Thu, Dec 9, 2010 at 3:05 AM, Pedro Costa <[EMAIL PROTECTED]> wrote:

> Hi,
>
> 1 - Hadoop MR contains a TaskMemoryManagerThread class that is used to
> manage memory usage of tasks running under a TaskTracker. Why Hadoop
> MR needs a class to manage memory? Why it couldn't rely on the JVM, or
> this class is here for another purpose?
>
> 2 - How the JT knows that a Map or Reduce Task finished? Is through
> the heartbeat?
>
> Thanks
>
> --
> Pedro
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB