Yuzhang Han 2013-06-18, 19:30
-Re: How is the memory usage of containers controlled?
Arun C Murthy 2013-06-18, 20:07
NodeManagers monitor containers w.r.t memory usage, and put containers in cgroups with cpu limits to restrict CPU usage.
On Jun 18, 2013, at 12:30 PM, Yuzhang Han <[EMAIL PROTECTED]> wrote:
> I am curious about how YARN containers control their memory usage. Say, I have a MR job, and I configure that every map task should be assigned a 1 GB container, and every reduce task a 1.5 GB one. So, when YARN runs the containers, how is it ensured that all map containers use less than 1 GB memory and all reduce containers less than 1.5 GB? Is container memory control realized via -Xmx arguments in the scripts generated by YARN to invoke the MR program in the containers?
> Thank you.
Arun C. Murthy