Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Memory Leak while using LocalJobRunner

Subroto 2013-05-17, 14:39
Copy link to this message
Re: Memory Leak while using LocalJobRunner

It's inconvenient, but you can try DefaultMetricsSystem.shutDown(). Please see if that works and file a ticket to make LocalJobRunner automatically do this on finish.

+Vinod Kumar Vavilapalli
Hortonworks Inc.

On May 17, 2013, at 7:39 AM, Subroto wrote:

> Hi,
> I have an application which uses LocalJobRunner to process MR Jobs. From the heap dump of my application I can see multiple object with Name $Proxy90;  happens to be created by org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(Callback).
> Every-time a LocalJobRunner is launched it creates JobTrackerInstrumentation and QueueMetrics.
> While creating this MetricsSystem ; it registers and adds a Callback to ArrayList which keeps on growing as the DefaultMetricsSystem is Singleton. Is it a known bug? Is there any workaround to empty this list?
> Cheers,
> Subroto Sanyal