|
|
raghavendhra rahul 2012-01-18, 07:24
Hi,
What is the minimum size of the container in hadoop yarn. capability.setmemory(xx);
Arun C Murthy 2012-01-18, 07:31
Removing common-user@, please do not cross-post.
On Jan 17, 2012, at 11:24 PM, raghavendhra rahul wrote:
> Hi, > > What is the minimum size of the container in hadoop yarn. > capability.setmemory(xx);
The AM gets this information from RM via the return value for AMRMProtocol.registerApplicationMaster.
Arun
raghavendhra rahul 2012-01-18, 07:37
What could be the minimum size.Because my cluster size is 2.5GB When i set 100 mb for each container only 2 instances are launched in each node. When i set 1000 mb for each container even then 2 instances are launched in each node. What could be the problem.
Sorry for the cross posting...
On Wed, Jan 18, 2012 at 1:01 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote:
> Removing common-user@, please do not cross-post. > > On Jan 17, 2012, at 11:24 PM, raghavendhra rahul wrote: > > > Hi, > > > > What is the minimum size of the container in hadoop yarn. > > capability.setmemory(xx); > > The AM gets this information from RM via the return value for > AMRMProtocol.registerApplicationMaster. > > Arun > >
Arun C Murthy 2012-01-18, 07:56
The default is 1000MB.
Try bumping down yarn.scheduler.fifo.minimum-allocation-mb to 100 (default is 1024) for FifoScheduler or yarn.scheduler.capacity.minimum-allocation-mb for CapacityScheduler.
Arun
On Jan 17, 2012, at 11:37 PM, raghavendhra rahul wrote:
> What could be the minimum size.Because my cluster size is 2.5GB > When i set 100 mb for each container only 2 instances are launched in each node. > When i set 1000 mb for each container even then 2 instances are launched in each node. > What could be the problem. > > Sorry for the cross posting... > > On Wed, Jan 18, 2012 at 1:01 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote: > Removing common-user@, please do not cross-post. > > On Jan 17, 2012, at 11:24 PM, raghavendhra rahul wrote: > > > Hi, > > > > What is the minimum size of the container in hadoop yarn. > > capability.setmemory(xx); > > The AM gets this information from RM via the return value for AMRMProtocol.registerApplicationMaster. > > Arun > >
Arun C Murthy 2012-01-18, 07:57
Sorry, wasn't clear - default is 1024 for both schedulers. Use those configs to tune them.
Arun
On Jan 17, 2012, at 11:56 PM, Arun C Murthy wrote:
> The default is 1000MB. > > Try bumping down yarn.scheduler.fifo.minimum-allocation-mb to 100 (default is 1024) for FifoScheduler or yarn.scheduler.capacity.minimum-allocation-mb for CapacityScheduler. > > Arun > > On Jan 17, 2012, at 11:37 PM, raghavendhra rahul wrote: > >> What could be the minimum size.Because my cluster size is 2.5GB >> When i set 100 mb for each container only 2 instances are launched in each node. >> When i set 1000 mb for each container even then 2 instances are launched in each node. >> What could be the problem. >> >> Sorry for the cross posting... >> >> On Wed, Jan 18, 2012 at 1:01 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote: >> Removing common-user@, please do not cross-post. >> >> On Jan 17, 2012, at 11:24 PM, raghavendhra rahul wrote: >> >> > Hi, >> > >> > What is the minimum size of the container in hadoop yarn. >> > capability.setmemory(xx); >> >> The AM gets this information from RM via the return value for AMRMProtocol.registerApplicationMaster. >> >> Arun >> >> >
|
|